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(54) System and method for sampling and/or placing objects using low discrepancy sequences 



(57) A system and method for irrproved image char- 
acterization, object placement, mesh design and pat- 
tern matching utilizing Low Discrepancy sequences. 
The Low Disaepancy sequence is designed to produce 
sample points which maximally avoid one another, i.e., 
the distance between any two sample points Is maxi- 
mized. The invention may be applied specifically to 
methods of image characterization, pattern matching, 
acquiring image statistics, object location, image recon- 
struction, motion estimation, object placement sensor 
placement, and mesh design, among others. Image 
characterization is performed by receiving an image 
arxi then sampling the Image using a Low Disaepancy 
sequence, also referred to as a quasi-random 
sequence, to determine a plurality of sample pixels in 
the image which characterize the image. Sensor place- 
ment is performed by generating a Low Disaepancy 
sequence for the desired placement application, and 
then selecting locatior^ for the optimal placement of 
sensors using the generated Low Disaepancy 
sequence. The pattern matching method may operate 
to locate zero or more instances of a template image in 
a target image. The pattern matching method may per- 
form a local stability analysis around at least a subset of 
the sample pixels to determine differing stability neigh- 
borhood sizes and/or step sizes. The pattern matching 
method may also perform rotation invariant pattern 
matching by sampling the template image along one or 



more rotationally invariant paths, preferably drcular 
perimeters, to produce one or rTK)re sets of sample pix- 
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Description 

Reld of the Invention 

[0001 ] The present invention relates to applications s 
involving sanpling of objects, such as images, or place- 
ment or arrangement of objects, such as sensors, using 
Lew Discrepancy sequences, wherein the use of Low 
Discrepancy sequences provides improved efficiency. 
The present inverrtion includes, but is not limited to, io 
methods for sampling images, acquiring image statis- 
tics, locating a known object in an image, estimating the 
motion of objects in successive acquired images, deter- 
mining placement locations of sensors or other objects, 
determining polrrts to be used in a grid/inesh design, is 
characterizing a template image, performing pattern 
matching, and locating rotated arxi/or scaled images. 
The present invention also relates to improved pattern 
matching techniques. 

20 

Description of the Related Art 

[0002] In many applications it is necessary or 
desired to sample an image to generate sample pixels 
which characterize the image, rather than using every 25 
pixel of the image. These sample pixels can then be 
used in performing calculations and comparisons asso- 
ciated with the image. Sampling an image may be very 
advantageous in applications such as pattem matching, 
image reconstruction, and motion estimation. 30 
[0003] In addition, many applications require place- 
ment of multiple objects, such as sensors, within a given 
area. Here it is greatly desirat)le to optimally place the 
sensors for best coverage of the area, i.e., to place the 
sensors in locations which maximize reception. This 3S- 
allcws usage of a lesser number of sensors to cover an 
area, tfuis reducing cost. 

[0004] Prfor art techniques for sampling an image 
and for determining placement locations for objects 
have utilized either a homogeneous sampling, such as 40 
grid-based sampling, or have utilized random points or 
pixels within the placement or image area. However, 
each of the atme prior art techniques operates to 
select a siteet of the total available pixels or total pos- 
sOt)le locations which does not necessarily best repre- 45 
sent or characterize the image or placement objectives. 
[0005] For example, an Improved system and 
method is desired for characterizing an image with a 
fewer number of sample pixels. Image characterization 
is used, for example, in performing correlation based so 
pattem matching. Pattem matching applications often 
apply an image sampling method to characterize the 
temple image with a lesser number of sample pixels. 
Pattern matching applications are used to find instarK;es 
of tiie template image or image object in a larger target 55 
image. Examples of pattern matching applications 
include machine vision applications such as process 
nfK)nitoring. feedback control, and laboratory automa- 



tion; image and video compression; and jitter compen- 
sation in video cameras; among others. 
[0006] Many other operatior^ require and/or desire 
a more efficient characterization of images. Examples 
include methods of acquiring image statistics, such as 
mean gray-level value or standard deviation of gray-lev- 
els, methods for locating a known object in an image. 
metfKXjs for estimating the nxslion of objects in succes- 
sive acquired inmges. image registration methods, and 
methods for cofor matching, among others. Therefore, 
an improved system and method is desired for charac- 
terizing an image. More particularly, an improved sys- 
tem arxJ method is desired for characterizing or 
selecting samples or pixels from a terrplate image 
which best represerrt ttie template image with the fewest 
samples possit)le. 

[0007] As discussed atxive. in many applications it 
is desired to determine tiie optimal placement locations 
for sensors within a given area. Fa example, a CCD 
(charge coipled device) sensor in a camera comprises 
an array of light sensitive electronic capacitors (CCD 
sensor elements) IhsA are typically placed in a grid 
based pattern. If fewer CCD sensors elements could t>e 
used, the cost of the CCD sensor would be lessened. 
Placement of CCD sensor elements according to a uni- 
form grid or rarxjom placement procedure may not pro- 
vide the optimal locations for the sensors. Therefore an 
improved method is desired for determining the place- 
ment locations for CCD sensor elements. Olher applica- 
tions where tiie optimal placement of sensors is desired 
include the placement of temperature sensors arxJ 
microphones in a planar array, as well as placement of 
transmitters/receivers (sensors) for radar, sonar, topog- 
raphy, and niagnetic resonance imaging applications. 
[0008] Meshes are used inmany engineering appli- 
cations including mechanical, structural, and design 
applications. Prfor art methods typically use a grid 
based mesh, wherein the vertices of the mesh are 
placed according to a grid pattern. If a fewer number of 
vertices is used, while achieving sut)stantially the same 
results, computer memory, time, and other resources 
are reduced. Therefore an improved method for deter- 
mining mesh vertices is desired. 
[0009] Therefore, improved systems and methods 
are desired for optimally sampling objects, such as pix- 
els in an image; for optimally placing or arranging 
ot]jects, such as sensors; arxl for optionally determining 
locations of vertices in a grid or mesh design. 

Pattem Recognition 

[0010] In many applications it is necessary or 
desired to find a template image or image object in a 
larger target image. Such applications include machine 
vision applications including process monitoring, feed- 
back control, and laboratory automation; image and 
video compression; and jitter compensation in video 
cameras, among others. 
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[0011] Prior art pattern recognition systems have 
typically used a template matching technique wherein 
the stored image or pattern to be located, refened to as 
the template, is iteratively compared with various corre- 
sponcfing portions of an in^ge in which it desired to 5 
locate the tenrplate, referred to as the target image. Fig- 
ure 17 illustrates the pattern matching problem as 
known in the prior art. As shewn, the pattern matching 
problem involves a terrplate image, wherein one or 
more instances of the template image are desired to w 
located in the target image. The template image and the 
target image are provided to a pattern matching algo- 
rithm which performs ttte pattern matching. The pattern 
matching algorithm generally operates to compare the 
pixels in the template image, or a selected subset of 75 
sample pixels, against each of the possible various 
locations in the target image. Typically, the pattern 
matching algorithm involves comparing the terrplate 
image, or a sut>set of sample pixels representing the 
template image, against locations in the target image on 20 
a horizontal pixel column basis arxi horizontal scan line 
basis. In other words, the sample pixels representing 
the terrplate image are compared against a portion of 
the pixels in the target image, such as by using a 2D 
correlation, the sample pixels representing the template 2s 
are then moved down or across a one pixel scan line or 
one pixel column in the target image, and the pattern 
matching algorithm is repeated, etc. Thus, the pattern 
matching algorithm generally involves comparing the 
template image pixels against all possible locations in 30 
the target image in an iterative fashion. The pattern 
matching produces the location of the template in the 
image, the quality of match and possibly the orientation, 
size and/or scaling of the template. 
- [0012] The template is compared with portions of as 
the target image typically utilizing a correlation based 
pattern matching, i.e., using normalized two dimen- 
sional correlation (normalized 2D correlation). This 2D 
correlation is performed by placing the tenplate over 
the respective portion of the image and performing a 4o 
complete normalized 2D correlation between the pixels 
in the terrplate and the pixels in the corresponcfing por- 
tion of the image. This correlation generally produces a 
correlation value which indicates the degree of conela- 
tion or match. For example, the correlation value may 45 
range between -1 and +1, wherein +1 indicates a com- 
plete match, 0 indicates no match, i.e., that the two 
images are uncorrelated, and -1 indicates that the two 
images are anti-correlated, i .e. . a complete reversal of a 
match. 50 
[0013] The normalized 2D correlation operation is 
based on a point-wise multiplication wherein the tem- 
plate is first placed over a portion of the image, each 
point or pixel of the template is multiplied with the corre- 
sponding pixel in the respective portion of the image. 55 
and the result is summed over the entire template. Also, 
as noted atxTve, the template image is gerierally com- 
pared with each possible portion of the target image in 



an iterative fashion. This correlation-based pattern 
matching technique is tftus very computationally inten- 
siva 

[0014] Various optimizations or algorithms have 
been developed to provide a more efficient correlation- 
based pattern matching. One prior art technique is to 
use selected samples or pixels from the template 
image, referred to as sample pixels, to represent the 
terrplate image and hence to reduce the number of 
computations in the correlatioa 
[0015] Figure 18 illu^tes the pattern matching 
process of the prior art wfiich involves cfiaracterization 
of the template with a reduced number of sample pixels. 
In this process, a characterization of the template is per- 
fornied to extract features from the template image. In 
other words, the template is characterized to represent 
the template image with a lesser number of points or 
pixels, referred to as sample pixels, which presumably 
accurately characterize the template image. The tem- 
plate image is characterized in this fashion because the 
time required for the pattern matching is generally 
directly proportional to the number of points or pixels 
representing tfre template inmge which are used in the 
pattern matching. Thus the terrtplate is characterized to 
reduce the number of samples or pixels which are used 
in the correlation operation, thereby redudng the 
anrxHint of computation. Once a lesser number of sam- 
ple pixels have been generated, these sample pixels are 
then used in the pattern matching algorithm to locate 
instances of the template image in the target image. 
[0016] Prtor art techniques for characterizing the 
template image have utilized a hiorTX)geneous sampling 
of the template, such as a grid-based sampling of the 
terrplate. Another prior art technique is to utilize ran- 
dom points or pixels within the template image and to 
use these random sample pixels in the correlation- 
t>ased pattern matching. However, each of the above 
prior art techniques operates to select a sut>set of the 
pixels in the template image which do not necessarily 
best represent or characterize the template image. In 
other words, homogeneous sampling or rarvfom sam- 
pling of the template image does not produce the opti- 
mum sut)set of samples or pixels which t^est represent 
the template image. 

[0017] Therefore, an improved system and metfxxf 
is desired for correlation based pattern matching. More 
particularly, an improved system and method is desired 
for cfiaracterizing or selecting samples or pixels from a 
terrplate image v^iich t>est represent the template 
image with the fewest samples possit)le. 
[001 8] In addition, an improved system and method 
is also desired which reduces the number of conelation 
operations which are required in a pattern matching 
operation. Further, improved techniques are desired for 
performing pattern matching for rotated images, trans- 
lated images and images which have changed in size. 
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Summary of the Imrentlon 

[0019] The present invention comprises a system 
and method for improved image characterization, object 
placement mesh design, and pattern matching utilizing 
Low Discrepancy sequences. The present invention 
may be applied specifically to methods of image charac- 
terization, pattern matching, acquiring image statistics, 
object location, image reconstruction, motion estima- 
tion, object placement sensor ptecement and mesh 
design, among others. While these applications are dis- 
cussed specifically and in detail, they are not intended 
to limit the use of Um Disaepancy sequences in other 
applications. 

[0020] In a first embodiment, the present invention 
comprises a system and method for performing image 
characterization using Lew Discrepancy sequences. 
The image characterization is preferatity performed in a 
conputer system. The image is received by and/or 
stored in the computer system and comprises a first plu- 
rality of pixels. The system and method comprises sam- 
pling the image using a Low Discrepancy sequence, 
also referred to as a quasi-random sequence, to deter- 
mine a plurality of sample pixels in the image which 
characterize the image. The Low Discrepancy 
sequence is designed to produce sample points which 
maximally avoid one another, i.e., the distance between 
any two sample points is maximized. Also, the Low Dis- 
crepancy sequence sampling results in fewer points and 
provides a better characterization of the image than a 
random sequence sampling or a unrfonm sampling. 
Examples of the Low Discrepancy sequence include 
Hafton, Sobd, Faure, and Niederrerter sequences. 
[0021] Pattern matching is one embodiment in 
which inrage charactertzatiorT using Low Discrepancy 
sequences rrtay provide a significant increase in effi- 
ciency. In a pattem matching application, a template 
image is received and/or stored in the corrputer system 
and corrprises a first plurality of pixels. According to 
one pattern matching embodiment, the system and 
method first corrprises sampling the template image 
using a Low Discrepancy sequence, as described 
above. The sampling or characterization of the terrplate 
image is preferably performed off-line prior to receipt of 
a target image. Thus the sarrpling or characterization of 
the template image is preferably not constrained by real 
time requiren^ents. After the terrplate image Is sampled 
or characterized, the target image Is preferat)ly acquired 
by the corrputer system, through a camera or any other 
image capture method. The method then performs pat- 
tern matching usirrg the sample pixels of the template 
image and the target image to determine zero or rrx>re 
locations of the template image in the target image. 
[0022] Irrrage characterization using Low Discrep- 
ancy sequences may also be used In other applications, 
such as acquiring image statistics, locating a known 
object in an image, estimating motion vectors indicating 
movement of objects In successive images, image 



reconstructbn, image compression, and color match- 
ing, anrang others. 

[0023] In a second embodiment, the preserrt inven- 
tion corrprises a system and method for optimally plac- 

5 ing sensors in a 2D array. In this embodiment, a 
corrputer system generates a Low Discrepancy 
sequence for the desired placement application. The 
computer system then selects locations for the optimal 
placement of sensors using the generated Low Disaep- 

10 ancy sequence. 

[0024] In one embodiment of the present invention, 
a placement method for CCD sensor elements using a 
Low Discrepancy sequerrce may enat)le a CCD sensor 
to receive substantially similar sensory Information (as 

IS that from a grid t>ased array of CCD serrsor elements) 
while reducing the number of CCD sensor elements 
required. In this embodiment, the area of the CCD sen- 
sor panel (the area in which the CCD sensor elements 
will be placed) and the nurTt>er of desired CCD sensor 

20 elements may first be received by the computer system. 
This information may either be calculated by the corrpu- 
ter or entered by the user, or obtained in any other man- 
ner. The computer then generates a Low Discrepancy 
sequence based on this information to determine the 

25 desired CCD sensor element locations on the CCD sen- 
sor panel. The generated locations represerrt the opti- 
mal locations for the desired number of CCD sensor 
elements. The CCD sensor Is then constructed, wherein 
the sensor elements are placed at the locations indi- 

30 cated by the Low discrepancy sequence. The CCD sen- 
sor way be constructed by a user or by a machine, e.g., 
robotics. 

[0025] The system and method of the present 
invention may be used for optimally placing other 

35 objects or sensors' within a 2D or 3D array7 such ^ 
placement of temperature sensors and microphones in 
a planar array, as well as placemerrt of trarrsmit- 
ters/ireceivers (sensors) for radar, sonar, topography 
arKi magnetic imaging applications, among others. 

40 [0026] In a third enrrbodiment, the system and 
method of the present Invention may be used to create 
meshes using Low Discrepancy sequences. Meshes 
are used by many engineering applications including 
mechanical, structural, and design applications. The 

45 present invention can be used to optimally create the 
mesh design, thus achieving improved results and/or 
irrproved efficiency. 

[0027] In a fourth embodiment the method and sys- 
tem uses local stability analysis to aid in pattern match- 
so ing. The method and system may first comprise 
sampling the template image, wherein the tenplate 
image corrprises a first plurality of pixels, and wherein 
the sampling produces a second lesser number of sam- 
ple pixels. This sampling may use any of various sam- 
55 pling techniques, including a Low Discrepancy 
sequence as descrbed atxsve. 
[0028] The method then performs a local stability 
analysts around at least a sut>set of the sanrple pixels to 
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determine a lesser third number of sample pixete which 
have a desired degree of stability. The local stability 
analyst operates to ensure stability of each of the sut>- 
set of sample pixels to spatial perturbations around the 
sample pixel. For each pixel, the local stability analysis 
pr^erably comprises fincfing a neightx)rtYood around 
the sample pixel where the value of the sample pixel 
conelates highly with the tennplate image pixel values in 
the neighborhood. The local stability analysis is prefera- 
bly performed for all of the sample pixels. The method 
then performs a pattern matching using the third plural- 
ity of sample pixels and the target image to determine 
zero a wore locations of the template image in the tar- 
get in^ge. 

[0029] In one emtxxliment the local stability analy- 
sis determines a plurality of sets of sample pixels with 
differing stability neighborhood sizes, and the pattern 
matching comprises performing a plurality of iterations 
of pattern matching using cfifferent sets of sample pix- 
els. The iterations may t>e performed in a coarse to fine 
n^anner, e.g.. using s^ of sample pixels with succes- 
sively smaller stability neightxxhood sizes. These plu- 
rality of iterations of pattern matching may also use 
different step sizes for each of the different sets of sanv 
ple pixels, wherein the step size preferably conesponds 
with the stability neighborhood size. Thus the plurality of 
iterations of pattern matching in the coarse to fine man- 
ner may use sets of sample pixels with successively 
sn^ler stability neighborhood sizes and/or succes- 
sively smaller step sizes. For example, a first iteration of 
pattern matching may determine one or more candidate 
locations in the target image which possibly include the 
terrplate image, and one or mere second iterations of 
pattern matching are performed at the determined one 
or more candidate locations in the target image, arxj so 
on. 

[0030] In a fifth embocfiment. the present invention 
comprises a system and method for performing pattern 
matching to locate one or wore instartces of a rotated or 
scaled tennplate image in a target image. The method 
connprises first sampling the template image along one 
or wore rotationally invariant paths, preferat)ly circular 
perimeters, to produce one or more sets of sample pix- 
els. The method then comprises performing pattern 
matching using a cyclic correlation between each of the 
one or more sets of sample pixels and the target image 
to determine zero or more locations of the tenplate 
image in the target image. This pattern matching 
detects rotated versions of the template image in the 
target image. 

[0031] In one embodiment, the method includes 
perfonfTvng a local stability analysis around at least a 
subset of the sanple pixels. The method then performs 
pattern matc^ng using one or more sets of sample pix- 
els along one or wore circular perimeters based on the 
local stability analysis. The local stability analysis rmy 
deternvne a plurality of sets of sample pixels with differ- 
ing stability neight>orhood sizes. In this case, the pattern 



matching comprises performing a plurality of iterations 
of pattem matching using different sets of sample pix- 
e^ preferably in a coarse to fine manner. e.g.. using 
sets of sanple pixels from circular paths with succes- 

5 sively smaller stability neighborhood sizes. The pattem 
matching may also use different step sizes for each of 
the different sets of sample pixels. As cf scussed above, 
a first iteration of pattem matching may determine one 
or nK>re candidate locations and conesponding rotation 

10 values in the target image which possibly include the 
terrplate image, and one or more second iterations of 
pattem matching are performed at the determined one 
or more candidate locations in the target image using 
the respective rotation values, and so on. A final pattem 

15 matching may utilize sut)stantially all of the template 
image pixels at the respective candidate locations and 
using the determined rotation values. 

Brief Description of the Drawings 

20 

[0032] A t>etter understanding of the present inven- 
tion can be obtained when the following detailed 
description of the pr^erred embodiment is considered 
in conjunction with the following drawings, in which: 

25 

Rgure 1 illustrates a computer system which may 
be used for image characterization, sensor place- 
ment or pattem matching according to the present 
invention; 

30 Rgure 2 is a flowchart illustratng a method of 
image characterization using a Low Discrepancy 
sequence; 

Rgure 2A is a graph illustrating an array of ran- 
domly selected coordinates on a 2D grid; 
35 Rgure 2B is a graph illustrating an array of coordi- 
nates selected k)y a Low Discrepancy sequence on 
a 2D grid; 

Rgure 3 illustrates an image acquisition or video 
capture system according to one embodiment; 
40 Rgure 4 is a high-level block diagram of the image 
aoquisitfon system; 

Rgure 5 is a flowchart illustrating a pattern match- 
ing method using a Low Disaepancy sequence; 
Rgure 6 is a flowchart illustrating a method of 
45 acquiring image statistics using a Low Disaepancy 
sequence; 

Rgure 7 is a flowchart illustrating a method of 
image reconstrucbon using a Low Discrepancy 
sequence; 

50 Rgure 8 is a flowchart illustrating a method of 
motion estimation using a Low Discrepancy 
sequence; 

Rgure 8A is a flowchart illustrating a second type of 
motion estimation using a Low Discrepancy 
55 sequence; 

Rgure 9 is a flowchart illu^ting a method of locat- 
ing an object within an image using a Low Disaep- 
ancy sequence; 



5 



9 



EP1 018708 A2 



10 



Figure 10 is a flowchart illustrating a method of 
placing objects within a deternrined spatial area 
using a Low Discrepancy sequence; 
Figure 11 is a fiGwchart illustrating a niethod of 
placing sensors within a deterntined spatial area s 
using a Low Discrepancy sequence; 
Rgure 12 is a flowchart illustrating a method of 
placing CCD sensors within a determined spatial 
area using a Low Discrepancy sequence; 
Figure 12A is an example of CCD sensor elements io 
placed using a grid based pattern; 
Figure 12B is an example of CCD sensor elements 
placed using a Low Discrepancy sequence; 
Figure 1 3 a flowchart illustrating a method of gen- 
erating a mesh using a Low Discrepancy sequence; 75 
Rgure 14 is a flowchart illustrating a method of 
placing sensors within a determined three dimen- 
sional spatial area using a Low Discrepancy 
sequence; 

Rgure 15 is a flowchart illustrating a method of 20 
acquiring image statistics from a 3D image using a 
Low Disaepancy sequence; 
Rgure 16 is a flowchart illustrating a method of 
acquiring image statistics from a 1 D signal usir^g a 
Low Discrepancy sequence; 25 
Rgure 17 illustrates the pattern matching as per- 
formed in the prior art; 

Rgure 18 illustrates pattern matching performed in 
the prior art which includes characterization of the 
template image with fewer pixels for reduced com- 30 
putation; 

Rgure 19 is a flowchart diagram illustrating the gen- 
eration of sample pixels using local stability analy- 
sis according to the preferred embodiment; 
- Rgure 20 is a flowchart diagram illustrating the pat- 35 
tern matching method using a coarse to fine search 
according to the preferred embodiment; 
Rgure 21 is a flowchart diagram illustrating the pat- 
tern matching method of the preferred entxxiiment 
incorporating the flowcharts of Rgures 5, 1 9-20; 40 
Rgures 22a - 22f illustrate pattern matching without 
a step size according to the prior art; 
Rgures 23a - 23f illustrate pattern matching using a 
9x9 step size based on local stability analysis per- 
fornr>ed according to the present invention; 45 
Rgures 24a - 24f Illustrate pattern matching using a 
5x5 step size based on local statxlity analysis per- 
formed according to the present invention; 
Rgure 25 is a flowchart dagram illustrating the pat- 
tern matching method for rotation invariant match- so 
ing according to the present invention; 
Rgure 26 is a flowchart cfiagram illustratir^ the pat- 
tern matching method for rotation invariant match- 
ing according to the preferred embodiment of the 
present invention; and ss 
Rgures 27A, 27B and 28 illustrate the rotation 
invariant pattern matching method. 



Detailed Description of the Prefenred Embodiment 

[0033] The present invention comprises a system 
and method for performing image characterization 
using Ljow Discrepancy sequences, for producir^ opti- 
mal object placement locations using Low Discrepar^cy 
sequences and for producing effective mesh designs 
using Low Disaepancy sequences. 

Rgure 1 - Co mputer SystOT 

[0034] Rgure 1 illustrates a computer system 102 
which may be used according to the present invention. 
The computer system 102 may be used, for exanrple, to 
perfomi image characterization, pattem matching, gen- 
eration of image statistics, image location, and motion 
estimation, using Low Discrepancy sequences. The 
computer system 102 may also be used to perform 
object or sensor placement such as for CCD sensor ele- 
ments, microphones, temperature sensors, etc.. using 
Low Discrepancy sequences. The computer system 
102 nriay furttier be used to determine vertex locations 
in a grid or mesh design. The computer system 1 02 may 
also be used to perform enhanced pattern matching 
techniques, such as local stability analysis or rotation 
invariant pattern matching. The computer system 102 
comprises one or more processors, a memory, a dis- 
play, and an input such as a keytx^ard or nfK>use, and 
any other components necessary for a computer sys- 
tem. 

[0035] The present Invention is preferably Imple- 
mented by one or more software programs stored on a 
merTX)ry medium of the corrputer system and executed 
by a processor of the computer system. TTie term "proc- 
essor" is intended to include various types of proces- 
sors. CPUs, DSPs, microcontrollers, or programmable 
logic, among others. The term "memory medium" is 
intended to Include various types of menx>ry or storage, 
including an installation medium, e.g.. a CD-ROM. or 
floppy disks 104, a computer system menx>ry such as 
DRAM, SRAM, EDO RAM, Rambus RAM. etc.. or a 
non-vdatite menfx)ry such as a magnetic media, e.g., a 
hard drive, or optical storage. The memory medium may 
comprise other types of memory as well, or combina- 
tions thereof. In addition, the menrxTry medium may be 
located in a first computer in which the programs are 
executed, or may be k)cated in a second different com- 
puter which connects to the first conputer over a net- 
woric In the latter instance, the second computer 
provides the program instructions to the first computer 
for execution. 

[0036] Also, the computer system 102 may take 
various fom^ including a personal computer system, 
mainframe computer system, workstation, network 
appliance. Internet appliance, personal digital assistant 
(PDA), television system or other device. In general, the 
term "computer system" can be broadly defined to 
erKX)mpass any device having a processor which exe- 
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cutes instructions from a memory medium 
[0037] The software program may t>e implemented 
in any of various ways, induding procedure-based tech- 
niques, component-based techniques, and/or object- 
oriented techniques, among others. For example, the s 
software program may be implemented using ActiveX 
controls, Cih- objects, JavaBeans, Microsoft Foundation 
Classes (MFC), or other techrwiogies or methodolo- 
gies, as desired. A processor executing code and data 
from the memory medium compr^es a means for sam- 
pling and/or placing objects accorcfing to the methods or 
flowcharts descrbed belcw. 

[0038] The computer system 102 is operat»le to cal- 
culate Low Discrepancy sequences and use these 
sequerK^es for sampling pixels of an Image (image char- 
acterization) or for determining locations or placement 
of objects or sensors (sensor placement), or for deter- 
mining vertex locations in a mesh design. The computer 
system 102 is also operat)le to perform improved pat- 
tern matching techniques. 

[0039] Low DiscreparKy sequences comprise 
mathematical sequences that are efficient samples of 
high dimensional spaces. A Low Discrepancy sequence 
is also referred to as a quasi-random sequence or a 
sutMandom sequence The Low Discrepancy 
sequence is designed to produce sample points or loca- 
tions which maximally avoid each other, e.g., is 
designed to produce sample pixels which best repre- 
sent an image or points/locations which best cover an 
area. Examples of Low Discrepancy sequences include 
the Hatton sequence, the Sobd sequence, the F^re 
sequence and the Niederreiter sequence, wherein dif- 
ferences between these are minor from a real worid 
applications point of view. Sampling an image using a 
- -Low Discrepancy sequence results in fewer sample pix- 
els to characterize the image and/or a t)etter character- 
izatbn of the image than would a random sampling 
technique or a uniform sampling technique. Determin- 
ing object or sensor placement using a Low Discrep- 
ancy sequence results in improved or optional coverage 
of an area with a minimal number of objects or sensors. 
[0040] The following is an example of the genera- 
tion or operation of a Low Discrepancy sequence 
(Hatton set). 

[0041 ] Rrst, at step 1 the method selects the type of 
Low DiscreparK:y sequence, e.g.. Halton, 2d (2-dimen- 
sional). In general, mathematicians are interested in nd 
applications of low-discrepancy sets where n > 10, 
sometimes n > 100. However, for a 2-dimenslonal appli- 
cation, a 2d sequence is used. 
[0042] At step 2 the method then selects a criteria 
for construction of the Halton set, for example, construc- 
tion in the unit square [0.1] x [0. 1], it being noted that the 
general case can be derived by a scaling operation. 
[0043] At step 3 the method then selects two prime 
numbers p and q. It is very common to use p = 2 and q 
- 3, although this is not necessary. Every pair of (p.q) 
results in a slightly different Halton set, wherein all of 



these sets are equivalent. 

[0044] The variables (Xn,yn) denote the nth element 
of the Halton set Oiven n. at step 4 the method notates 
n in the p^ary system (in the case where p=2 it Is the 
well-known binary system). The result is 
n = a^, ... a^.ao where the a*s are 0 or 1 incaseofthe 

binary system, txit 0, 1 p-1 in the general case. 

[0045] At step 5, the method then reverses the 

order of a^, ... ai, aQ. This results in ao. a^ a^. 

[0046] At step 6 the method then adds the (n-ary) 
point, i.e. O.aK-. ai ao- This nuiTt>er is in between 0 and 
1 and represents the x-component of the nth Halton 
point (xn,yn). 

[0047] At step 7 the method repeats steps (4) - (6) 
based on the other number system q. This produces the 
y-corrponent 

[0048] After steps 1 - 7, the nth point of the Halton 

sequence has been constructed. 

[0049] The following is an exanrple of the construc- 

tfon of a Low Disaepancy sequence in 2d. Here it is 

assumed that p = 2 and q = 3. This exarrple determines 

the 10th element i.e., (x^o^yio)- 

[0050] The method starts with the x-component as 

follows: 

(4") 10=1010 (decimal=binary) because 

10=1*8+0*4+1 •240*1 

(51 reverse the order -> 0101 

(61 add the point -> x1 0=0.01 01 (0.0101 

can be translated into 

0*(iy2>f1*(1/4)40*(1/8)+r(1/16)=1/4 + 1/16 =5/16 

[0051] Now the y-corrponent is corrputed as fol- 
lows: 



(4") 10=101 (decimabternary) because 

10=1*9*0*3+1*1 

(5") reverse the order -> 101 

(6T add the point -> y10=0.101 (0.101 can be 

translated into 1*(1/3)+O*(1/9)+1*(1/27)=10/27 

[0052] Two irrportant advantages of Low Disaep- 
ancy sequences are that 1) the generated sequence 
values are designed to maximally avoid each other, thus 
providing optional sampling and object placement; and 
2) each additional element of the sequence may deliver 
the optimal location of the next element In many cases, 
a relatively small number of sarrples may be sufficient 
to produce good approximations. These advantages will 
be seen as multiple embodiments of the image charac- 
terization and object placement methods are deserved. 
[0053] For more information on Low Disaepancy 
sequences, please see "Numerical Recipes in Fortran 
77: The Art of Scientific Conputing" (ISBN 0-521- 
43064-X) Cambridge University Press, pgs. 299 - 306, 
which is hereby incorporated by reference as though 
fully and completely set forth herein. 
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naure 2- tmaoe Characterization Method 

[0054] Rgure 2 is a flowchart illustrating an Image 
characterization system and method for representing an 
image with a reduced number of pixel values according s 
to the present invention. The method shown in Rgure 2 
may be used to characterize or represent an image for 
any of various different types of applicatia^ including, 
but not Gmited to. pattern matching, image statistics, 
object location, image reconstruction, and motion esti- 
mation. 

[0055] As shown, in step 402 an image is received 
by or stored in the computer system 102. The image 
may be received from any of various sources, as 
desired. For exarrpte. fhe image may be received wet 
a network, or may have t>een previously stored on the 
computer. The image preferably comprises a plurality of 
pixels (or sii>-pixels). 

[0056] In step 404 the image is characterized or 
sampled to represent the image using less than all of 
the total image pixels. In other words, the image pixels 
are sampled accorcfing to a Low Discrepancy 
sequence, i.e., are sampled at pixel locations iderttified 
by a Lew Disaepancy sequence. These sample pixels 
are stored in the computer system 102 and are useable 
to represent the image using a fewer number of pixels. 
In step 404, the corrputer 102 may operate to generate 
a Low Discrepancy sequence, and then sample pixels in 
the image based on the generated Low Discrepancy 
sequence. 

[0057] The numt>er of sample pixels generated may 
be selected by a user or may be selected by the compu- 
ter according to some desired accuracy metric. In one 
embodiment, the computer 102 receives user input indi- 
cating the desired number of samples and/or the 
desired granularity, and the computer 102 generates at 
least one Low Discrepancy sequence based on the user 
input. This user input may be received t>efore or after 
the image is received in step 402. Alternalivety, the 
computer 102 has pre-calculated and stored a Low Dis- 
crepancy sequence which is used in sampling the 
image. In this instance, the computer 102 may select a 
nunri>er of sequence elements in a pre-calculated Low 
Disaepancy sequence t>ased on received user input. 
[0058] Rgures 2A and 2B illustrate the difference 
between randomly selected sample pixels and sample 
pixels selected based on a Low Discrepancy sequence. 
The series of randomly selected sarrple pixels contains 
many clumps of sample pixels. Because each location 
is generated randomly, a random placement method 
does not take in to account prior random locations, and 
therefore, random sequences may not fill gaps appropri- 
ately. In contrast, the sanrple pixels generated by a Low 
Discrepancy sequence are positioned to maximally 
avoid one another. This means that each subsequent 
sample pixel location is placed in the largest available 
gap. achieving maximal avokJance by every sample 
pixel. In other words, every sample pixel is as far away 
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from all other sample pixels as possible. 
[0059] The image characterizatfon system and 
metfiod of the present invention may be used in a 
number of different applications, including various types 
of machine vision systems. e.g., indi^ial automation, 
robotic vision, traffc analysis, and image or vkieo com- 
pression, such as MPEG compression, among others. 

Rgure 3 - Machine Vision System 

[0060] Rgure 3 illustrates a machine vision applica- 
tion, wherein the computer system 102 is coupled to a 
camera 112 via cat^e 122 and operates to receive an 
image arxi perform image characterization and/or anal- 
ysis. The conputer system of Rgure 3 may be pro- 
grammed according to the present invention to 
characterize or represent a received image with a 
number of sanrple pixels, wherein the number of sample 
pixels is less than the total number of pixels in the 
imaga The computer system 102 may also l^e pro- 
grammed to perform other operations using the sample 
pixels, such as pattern matching, inr^ge statistic gener- 
ation, image reconstruction, motion estimation, or 
object location. These technk)ues may be used in vari- 
ous types of machine vision applications. For example, 
the conrputer 1 02 may be embodied in various form fac- 
tors and/or architectures. e.g., a robot or embedded 
de^ce. among others. It is also noted tiiat 0ie image 
characterization, pattern matching, image recor^lruc- 
tion, object location, image statistic generation, and any 
other technkfues of the present invention nnay be per- 
formed in any of various manners, either in software, 
programmable logic, or hardware, or a combination 
thereof. 

Rgure 4 - Video Capture System Block Diagram 

[0061] Rgure 4 is a high-level block diagram illus- 
trating one system for acquiring an image for sampling. 
It is noted that the block diagram of Rgure 4 is exem- 
plary only, and other computer system architectures 
may he used as desired. The present invention may be 
implenf^ed in a "smart camera", for exanple. which 
Integrates a sensa. analog to digital (A/D) converter, 
CPU and communications devrces together in a single 
unit The preserrt invention may be enrtKxfied in other 
devfoes, architectures or embodiments, as desired. 
[0062] Rgure 4 illustrates tiie host computer 102 
coupled to video source 1 12. As shown in Rgure 4, the 
host computer 102 may conprise a CPU 202. a bus 
bridge 204. system menK>ry 206. and a peripheral txjs 
212. The CPU 202 is coipled to tiie bus brkJge 204. The 
bus bridge 204 is coipled to the system menrx)ry 206 
and the CPU 202, and couples to the peripheral bus 
212. The peripheral bus 212 may be the PCI expansion 
bus. aKhough other types of buses may be used. 
[0063] In this embodiment, the host conputer sys- 
tem 102 also includes a vkieo capture board 214 which 
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is adapted for coupfing to the video source 112. The 
video capture boaid 214 is preferak)ty cotpled to the 
per^heral bus 212. In addition to the video capture 
tx>ard 214, other peripheral devices (216 and 218) may 
be coupled to the peripheral bus 212. such as aucfio 
cards, modems, graphics cards, network carcte, etc. 
[0064] The video source 112 suppHes the digital 
video signals to the video capture board 21 4. The video 
capture board 214 tranters the digitized video frames 
to the system memory 206 through peripheral bus 212 
and bus txidge 204. In this embocfiment the video cap- 
ture board 214 acquires the target image and transfers 
the target image to system menrK)ry 206. 
[0065] The system memory 206 may store an 
image or pattem, such as a template image or sample 
pixels generated from the template image. The system 
memory 206 also may store software aocorcfing to the 
present invention which operates to generate Low Dis- 
crepancy sequences, such as Halton or Sobol 
sequences. The software may t>e executable to sample 
or characterize an image, perform pattem matching, 
acquire image statistics, reconstruct images, and per- 
form motion e^mates. The software may also be exe- 
cutable to determine object placement locations, create 
a mesh, and perform other applications using Lx3w Dis- 
crepancy sequences according to the present invention. 
These applications are discussed further below. 
[0066] The present invention is preferably imple- 
mented in one or wore software programs which are 
executable by a processor or CPU. The software pro- 
gram(s) of the present invention are preferably stored in 
a memory medium, as described above, such as sys- 
tem memory 206. 

- Rqure 5 - Pattem Matching Using Low-Discrepancy 

Sampling 

[0067] Rgure 5 is a flowchart diagram illustrating 
operation of a pattern matching method of the present 
invention. Pattern matching may be executed at a nuxti 
more efficient rate and with fewer sample pixels using 
Low Discrepancy sampling methods rather tfian ran- 
dom or grid based sampling. The purpose of pattern 
matching is to find instances of a terrplate image within 
a target image or region of interest (ROl). The present 
invention provides an irrproved method for performing 
pattem matching on a computer system 102. 
[0068] In step 402 the computer receives and/or 
stores the template image in the computer, through 
video capture or any other metfKxi. In step 404 the tem- 
plate image is sampled using a Low Discrepancy sam- 
pling method, as descrit>ed in figure 2. In other words, a 
Low Discrepancy sequence is generated or used in 
selecting pixels, referred to as sanple pixels, which rep- 
resent the image. The sample pixels are stored in the 
computer memory in step 405. 
[0069] In step 406 the target image is received 
and/or stored in the computer system. In the embodi- 



ment of Rgure 3, the target image is received from the 
camera 1 12. hlowever, as noted above, the target image 
may be received from any of various sources, as 
desired. The target image is usually stgnificantiy larger 

5 than the tenplate image. 

[0070] In step 408 pattern matching is perfonned 
using the sanple pixels stored in ntemory in step 405 to 
f ind zero or more instances of the terrplate image in the 
target image. In the preferred emtxxiiment. the sarrple 

10 pixels determined in step 404 are iteratively corrpared 
with selected portions of the target image, preferably 
using a 2D correlation technique, to find matches and 
hence to determine instances or locations of the tem- 
plate image in the target image. The pattern matching 

15 may use a computed step size to step across the image 
and/or use a coarse to fine search method for improved 
efficiency. 

[0071] In another errbodiment. this method of step 
408 is inrplemented using a series of iterations be^n- 

20 ning with an iteration using a coarse tenrplate (i e. less 
sanple pixels) and sut>sequentty performing iterations 
using an increasingly fine (i.e. nruxe sanple pixels) tem- 
plate. Possible niches are preferably stored in mem- 
ory so that future iterations may apply the more fine 

^ template samples to only those areas, instead of the 
entire target image. This allows a quick response as to 
po6sit)le matches, while still allowing more precise 
matches to be determined. In tNs embodiment, a user 
may k>e at»le to view the results of each sul^sequent iter- 

30 ation and determine when the desired degree of cer- 
tainty is met. 

[0072] In many applications, it is necessary or 
desired to perform the pattern matching in real time 
when the target image is acquired. In machine vision 

35 applications, "real time" often refers to VkJeo real time", ~ 
i.e.. to performing the furK:tion for every single image 
acquired by the camera, e.g.. for a NTSC camera that 
acquires 30 frames/second. For exarrple, in the 
machine vision embodiment shown in Rgure 3, the pat- 

40 tern matching is preferably performed in real time when 
the target image is acquired by the camera 1 12. How- 
ever, in these real time embodiments, the template 
image is typically pre-stored in the computer 102, arxJ 
there is generally a large anxxjnt of time in which to 

45 characterize or process the tenplate image to produce 
the sample pixels. Once the sarrple pixels have been 
generated, the system can perform the pattern match- 
ing method a plurality of times for a plurality of acquired 
target images, preferably in real time. Thus, the sanple 

50 pixels may be generated and stored in steps 404 and 
405 prior to receipt of the target image in step 406. 
[0073] In step 41 0 the pattern matching results are 
generated, preferak)ly providing an indk;atk)n of the 
location(s) of the template image in the target image. 

55 The pattem matching method may also provide infor- 
mation on the orientation, size, and other information of 
the located terrplate image. 

[0074] tt is noted that steps 406^10 may be per- 
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formed a pturality of times for a pluralrty of acquired tar- 
get images. For more information on various pattern 
matching methods, please see the description relating 
to Rgures 19-28. 

Houre 6 - AcQuiring Image Statistics Using Low Dis- 
crepancy Sampling 

[0075] Computing the statistics of an image, such 
as the mean gray-level or standard deviation of gray-lev- 
els in an image, is an integral part of many image 
processing and machine vision applications. Other 
types of image statistics are required and/or necessary 
for different applications. The preserrt invention provides 
an improved method of acquiring image statistics using 
a reduced number of sample pixels which characterize 
tfie imaga 

[0076] Figure 6 is a flowchart illustrating one 
embodiment of producing image statistics for an image. 
As shown in Figures 15 and 16. discussed below, the 
same method may be applied or adapted for generating 
image statistics for a 3-D image or other 3-D volume or 
3-D data set. or for a 1 -D data set. such as a signal. TTie 
present invention may also be readily exterxied to other 
n-dimenstonal data sets. 

[0077] In step 402 of Figure 6, the computer 102 
receives and stores an image in the oonputer, through 
video capture or any other method. The image may be 
received over a network, or may have been previously 
stored on the computer, such as by a user. In the case 
of a 1-D. 2-D. 3-D or n-D data set the data s^ is 
received and stored in step 402A (Rgures 15 and 16). 
[0078] In step 404 the image is sampled using a 
Low Discrepancy sampling method, as described 
atxsve. The sample pixels are stored in menrK>ry in step 
405. The nunrt>er of sample pixels generated may be 
selected by a user or may be selected by the computer 
according to some desired accuracy metric. In the case 
of a 1-D. 2-D. 3-D or n-D data set, the data set is sam- 
pled in step 404A (Rgures 1 5 and 1 6) to produce a plu- 
rality of sample points which characterize the data set 
These santple points are stored in the computer 1 02. 
[0079] In step 420 the sample pixels are used to 
compute various image s ta t is tics. More specif icalty, the 
computer 102 uses the sample pixels to compute vari- 
ous image statistics accordng to various statistical 
gathering algorithms. This embodiment allows the 
desired pixel or image information (e.g., color, shading, 
perspective, eto.) to be obtained from the sample pixels, 
instead of requiring all of the image pixels to be used for 
this purpose. Because a reduced number of strategi- 
cally selected sample pixels are used (i.e., sample pix- 
els selected using a Low Disaepancy sequence rather 
than a ^id based, random, or any other selection 
method), the method's efficiency is improved. In the 
case of a 1 -D, 2-D, 3-D or n-D data set, data set statis- 
tics are conputed using the sanrple points in step 
420A(Rgures 15 and 16). 



[0080] In the absetKe of Low Discrepancy sam- 
pling, either grid-based or random sampling would likely 
be used to determine sample pixels or points for statis- 
tical gathering purposes. Experimental data has been 

5 recorded In reference to statistics gathered represent- 
ing tfie gray-level in an image using each of these sanv 
pling techniques. The experimental data shows tfiat the 
deviation from real gray-level is always less when sam- 
ple pixels are selected using a Low Discrepancy 

10 sequence rather than grid based algorithms or random 
selection. Thus, a Low Discrepancy sequence produces 
better results than grid-t>ased or random selection. 

Figure 7 - Reconstructing Imaoes Using Low Discreo- 
IS ancv Sampling 

[0081 ] Image reconstruction refers to the process of 
e^mating the values of certain pixels based on the val- 
ues of a given set of pixels in the image. Applications 

20 that require fa^ transmission of image/graphic data 
often choose to serxi less than all of the pixels in an 
image due to slow transmission speeds. By selecting 
the best pixels to sample and send. i.e.. the siteet of 
pixels which optinr^ly characterize the image, the qual- 

25 ity of an image may be greatiy improved. The receiving 
computer system receives the sample pixels and may 
operate to ^01 in tiie blanks" using surrounding pixel 
data. This means that if the sample pixels maximally 
avoid each other, the sample pixels will more accurately 

30 characterize or represent the image, and the recon- 
structed image will look more like the original image. 
[0082] Rgure 7 is a flowchart illustrating one 
embodiment of a image reconstruction metfiod. In step 
402 an image is received and/or stored by a computer. 

35 In a teleconferencing or other similar application, the 
image may be received from a video camera connected 
to tiie computer 102. The computer 102 may also be a 
web server which stores images for transmission over 
the Internet 

40 [0083] This image is then sampled in step 430 
using a Low Discrepancy sequence. In one emtxxji- 
ment. a pluralrty of different Low Discrepancy 
sequences may be used, each for different parts of the 
image. Thus, portions of the image with more detail, 

45 such as a face, can be sampled with a larger numt)er of 
samples, and portions of the image with less detail can 
t>e sampled witii a fewer numt>er of samples. Other 
compression techniques may also be performed on tiie 
sample pixel data to increase transmission time. 

50 [0084] In step 432 tiie sample pixels are transmitted 
to one or more remote corrputers. For example, the 
sanrtple pixels may be transmitted over a network, such 
as the Internet, using any of various transmission proto- 
cols. 

55 [0085] In step 434 the sample pixels are received 
by a renxTte computer. The sample pixels are generally 
accompanied by coordinate information indfoating the 
focation of each sanrple pixel within the image. Alterna- 
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tivety. the recdving computer may generate the same 
Low Discrepancy sequence as the transmitting compu- 
ter to determine placement off the sample pixels. This 
would avoid the requirement of the serv^ or transmit- 
ting computer having to transmit coordinate information 5 
with the sarrple pixels^ 

[0086] In step 436 the remote computer places the 
sanple pixels in their appropriate locatior^ such as in a 
frame buffer. 

[0087] In step 438 the oorrputer executes an algo- w 
rithm to fill the pxels that were not received into the 
frame buffer. The rnosX common method of reconstruct- 
ing a missing pixel is by averaging each off the pixels 
around its perimeter, txjt any other reconstruction 
method may t>e i^ed. After the pixels that were not is 
transmitted are reconstructed, in step 440 the computer 
102 (fisplays the complete image (i.e. the combination 
of the received sample pixels and the reconstructed 
remainder pixels). 

[0088] The remote corrputer may begin to refresh 20 
the display from the frame buffer as soon as any off the 
sample pixels are received. As more sample pixels are 
received arxl/or reconstructed, the clarity off the image 
increases. 

[0089] Reconstruction may also be performed for 2s 
pixels, or groups of pixels, that were sampled, but were 
lost or delayed in transmission. For example, in the case 
of video transmission over the Internet or othter network, 
there is a possibility that packets off image inffomiation 
vnll t^e lost corrupted, or more likely will not reach the 30 
destination in time to be used t>y real time video proces- 
sors. Nevertheless, the inr^ge data that was lost may be 
reconstructed by estimating the values off the missing 
pixels. This estimation typically t>ased on the pixel 
information off surrounding pixels or the image as a 35 
v^ole. In a real time environment a metfxxi that 
requires sanpling off every pixel may be too slow to use. 
Therefore a method that provides sut>stantiany similar 
results while saving computer cycles is desirable. The 
sampling may be performed on the image as a whole or 40 
a specified image portion (depending on the specific 
application) using a Low Disaepancy sequence in order 
to obtain image information that may be used to recon- 
struct missing portions off the image. The sampled data 
may be used to determine an average image color, or 45 
any other pixel attribute, v^ich may be used in replace- 
ment off missing pixels. 

[0090] In yet another emkxxliment. an image may 
be sent in a pixel-by-pixel format using sample pixels 
generated by a Low Discrepancy sequence. In other so 
words, the pixels may not be transmitted in a scan line 
format e.g.. left to right and top to bottom, but rather are 
transmitted according to a Low Discreparx^y sequence 
ordering. In this embodiment ail off the image pixels may 
also t>e sample pixels. The order off sample pixel selec- ss 
tion and trar^sffer is determined by a Low Disaepancy 
sequence. For example, an image t>eing sent across the 
Internet, pixel-by-pixel (or groups off pixels), is received 



by a remote computer. As each sample pixel is 
received, the sample pixel is stored in the fran^ buffer. 
On each saeen refresh, the current content of the 
frame buffer is rendered, and the renxite computer gen- 
erates an intermediate or granular representation of the 
image. Because the pixels maximally avoid one 
anotiier. at any time during the trar^ffer, the received 
sample pixels provide the optimal information for view- 
ing or digitally analyzing the image, based on the 
amount off data received. In other v«>rds. accorcfing to 
this embodiment, an image appears according to loca- 
tions selected by a Low Disaepancy sequence This 
may provide the remote user with image infformation on 
the entire image more effidentiy or more quickly. This 
embodiment may also provide the best representation 
off an image where the pixel-t>y-pixel data was inter- 
rupted or stopped. In addition, reconstruction of the 
received image may be performed in parallel with recep- 
tion off the sample pixels. In this embodiment as more 
pixel sarrples are received, the received sample pixels 
may actually overwrite reconstructed pixels. 

Figure 8 - Motion Estimation Using Low Disaeoancv 
Sampling 

[0091] Motion estimation is used in various fiekis, 
including the field off compression/decompression of 
video images. One compression metlKxJ. which is used 
in MPEG compression, involves the use off motion vec- 
tors. The method is implemerrted by dividing an image 
into search blocks. Each search block is compared to 
blocks off a target image (usually the previous and/or 
sufc>sequent image in the video sequence) to ffind the 
closest match. Once the closest match is found, a 
nxilion vector is aeated to refflect the nx>tion of that par- 
ticular block. The motion vector is transmitted in place of 
the search block. Motion vectors may hence be used in 
the video sequence to corrpress frames in tiie video 
sequence. Otiier effects may also be applied to the 
block to indicate changes in color, shade, lighting, etc. 
Comparing every pixel off a search block to every pixel of 
the blocks in a target image may be very time and power 
consuming. A method for reducing computing cycles 
and time needed to generate motion vectors is desired. 
[0092] Low Discrepancy sequences may be used to 
select certain pixels off a search image block to conpare 
vWth the corresponding pixels of target frame blocks. 
Rgure 8 illustrates an improved method off generating 
motion vector using Low Disaepancy sequences. 
[0093] In step 450 a computer receives and stores 
one or more search frame images. Each search frame 
image may comprise multiple search frame blocks. The 
search frame blocks may be macroblocks off a image 
t>eing compressed according to the MPEG standard. 
[0094] In step 452 a search image block is sampled 
using a Low Disaepancy sequence. This generates a 
number of sample pixels of the search image tkxk that 
is less than the total numt)er off pixels in ttie search 
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image block. As descnbed abcve. these sample pixels 
optimally characterize the search image block for the 
number of sample pixels used. 
[0095] A target image is then selected or received 
in step 454. The target image is generally a prior or sut>- s 
sequent frame to the search imaga The target image 
includes various image blocks that will be compared to 
the search image block to determine the best match. 
[0096] The sample pixels from the search image 
block are then i^ed to compare with various target 
image blocks from the target image in step 456. Once 
the closest match has been located within the target 
frame blocks, in step 458 a motion vector is generated 
which encodes this information. This process may be 
repeated for every search image block. This method 
can be used to create nation vectors more quickly than 
conventional methods. 

[0097] An alternative embodiment of niotion esti- 
mation is used in machine vision systems. In many 
applications it is necessary for a n^achine vision system 
to cope with moving and changing objects, changing 
illumination, and changing viewpoints, as the applica- 
tion requires information extracted from a dynamic envi- 
ronment. A sequence of image frames contains much 
more information to the understarxiing of a scene, txit at 
the ^cpense of larger amounts of data to t>e processed. 
Estimating the motion of objects or the scene in succes- 
sive acquired images is therefore desirable. Since 
rTX)tion estimation is most valuable if done in real-time, if 
every pixel of two sequential images is compared, the 
data processing load is tremendous arxi may produce 
useless delayed results due to computational lag or 
require a higher delay time between images. Therefore, 
utilizing sample pixels of acquired images may give an 
accurate analysis of cfianging concStions while mininriz- 
ing precious computer cycles. Historically, images were 
sampled using grid based patterns or random patterns. 
Using Lew Disaepancy sequences, however, provides 
improved results, or provides the same results while 
requiring fewer sanrple pixels to be used. 
[0098] One embodiment of nrxstion estimation is 
illustrated in the flowchart of figure 8A. In step 602 an 
image of the pertinent scene or object is acquired. TT^s 
image is sample in step 604 using a Lew Discrepancy 
sequence. The sample data may be stored in a memory 
rratrix 606 so it may be referred to by future comparison 
operations. A storage matrix is preferred if corrparisons 
are to be made between more than directly neighboring 
images. The stored sanrple data is compared to prior 
image data to determine if certain motions have 
occurred or are expected to occur. Steps 610-612 allow 
a plurality of motions to be detected or anticipated and 
to make the appropriate acQustments (614-616). This 
sequence is repeated, beginning at step 602 by acquir- 
ing the next image, as long as necessary. This method 
may be implement, but is not limited to. the fields of 
rotXTt navigation, autonomous vehicles, video coding, 
obtaining the structure of objects from nxjtion, and 



tracking objects. 

Rgure 9 - Object Location Using Low DisCTeparH:v 
SaoDQliog 

[0099] Object location refers to the process of 
quickly locating the position of a known object in an 
imaga For example, finding the location of a black 
square on a white t>ackground. Assuming an ideal black 
square (i.a ail black pixels are connected and there are 
no gaps between black pixels), the task can be accom- 
plished by finding one black pixel, from which the loca- 
tion of the complete square can be determined. 
[0100] Rgure 9 illustrates the process of object 
location. In step 460 the target image (the image to t>e 
searched) is acquired and stored in the corrputer. In 
step 462 one or wore template pixels are acquired 
and/or selected. In the exarrple of a search for an ideal 
t)lack square, the template pixel may be a single black 
pixel. It is noted that step 462 may occur before or after 
step 460. 

[01 01 ] In step 464 a location on the target image is 
generated using a Low Discrepancy sequence. In step 
466 the template pixel information (a black pixel in the 
example) is compared to the pixel information at the 
generated location on the target image. In step 468 the 
method then determines if the pixel information 
matches. If so. the object from which the template pixel 
was taken has been found. If there is rK> match, step 
464 generates a new location on the target image using 
the Low Discrepancy sequence arxj the comparison 
process of steps 464 and 468 is repeated. 
[0102] h is noted that the method descrtoed above 
can be easily nrxxiif ied for more complex object location 
prol)lems. _ - 

[0103] When this method was tested using Halton 
and SotX)l Low Disaepancy sequences, both out-per- 
formed random and grid based sequences when locat- 
ing an ideal black box on a white backgrourxl. While 
experimental results state that Halton and Sot>ol 
sequences prefer ttie two nmin orientations in the x arxi 
y Erection, even if the box is rotated, the Low Disaep- 
arKy sequences stilt perform better than both rarxiom 
sequerKes and grid based sets. 

Rgures 10. 1 1 and 14 - Detemiininq Locations for 
Object/Sensor Placement Using Low Discreoancv 
sequences 

[01 04] An application that requires the placement of 
objects tor k>est coverage of an area, and/or which 
requires great effort in pladng additional objects, and/or 
which requires considerable resources in the nxiving / 
setting ip of objects, may benefit by the use of Lew Dis- 
aepancy sequences for determining the placement of 
such objects. For exarrple. in many applications multi- 
ple sensas are required, such as in a 2D array or 3D 
volume, to cover ttie area and receive signals in the 
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area. Therefore, a method for ptadr^g sensors optimally 
in the area may allow a measurement to be completed 
with fewer sensors than required t>y a grid based place- 
ment 

[01 05] Rgure 1 0 is a flowchart illustrating a method s 
of placing objects within a determined spatial area (e.g., 
a 2-D area) using a Low Discrepancy sequence. Rgure 

10 illustrates that the method of the present invention 
may be used for placing or locating any of various types 
of objects using a Low Disaepancy sequence. Rgure 

1 1 is a flowchart illustrating a method of pladng sensors 
within a determined spatial area using a Low Discrep- 
arrcy sequence. For example, the sensors may be tem- 
perature sensors, pressure ser^rs. electrical sensors, 
microphones, transmitters, receivers, radar receivers, 
sonar receivers, and any other type of sensor or trans- 
ducer. Rgure 14 illustrates the method of placing 
objects or sensors within a 3<iimensional volume using 
a Low Discrepancy sequence. Each of Rgures 10. 11 
and 14 is descrbed below. 

[0106] As shown in Rgure 10. In step 502 the 
method first receives the dimensions of the 2<iimen- 
sional area (or 3D volume or 1 D space) in which the 
object (or sensor) will be placed. Where the object is a 
sensor, the method receives information regarding the 
2-D area or 3-D volume in which the sensor can be 
placed in step 502A (Rgure 11). In the case of a 3-D 
application, the method receives information regarding 
the 3-D volume in step 502B (Rgure 14). This informa- 
tion may be received from a user or may be generated 
by the computer 102 in response to other infomnation. 
[0107] In step 504 (or steps 504A or 504B) the 
method generates placement locations in the 2-D space 
(Rgure 10) or 3-D volume (Rgure 14) using a Low Dis- 
crepancy sequence. The nurri^er of values or elements 
in the Low Discreparxry sequence conesponds to the 
deterntined number of objects or sensors to be placed. 
Step 504 may involve generating the Low Discrepancy 
sequence, wherein the sequence indicates or specifies 
the placement locations. If the objects or sensors are 
being placed in a 2-D area, as in Figures 10 and 1 1 . the 
method generates a 2-D Low Discrepancy sequence. If 
the objects are being placed in a 3-D area, as in Rgure 
14, the mettKxl generates a 3-D Low Discrepancy 
sequence. Alternatively, the Low Discrepancy sequence 
may have been previously generated and stored. 
[0108] In step 506 (or steps 506A or 506B) the 
objects or sensors are then placed in the generated or 
determined locations. The objects or sensors may t>e 
placed using robotics or other types of machinery, or 
may be placed by a human. For example, in the manu- 
facture of a sensor comprising a number of sensor ele- 
ments, robotics or macNnery may manufacture the 
sensor with the sensor elements placed in the locations 
generated by the Low Discrepancy sequence. Alterna- 
tively, if the majority of possible object locations will be 
filled with objects, a smaller Low Discrepancy sequence 
may be generated to determine where objects will not 



be placed. The objects, placed according to the Low 
Discrepancy sequence, may provide inproved results 
as compared to a system using objects placed in a grid 
based or random pattern. 

Rgure 12 - CCD Placement Method 

[0109] A Charge-Coupled Device (CCD) serYSor is 
one exanple of the use of the sensor placement 
method of the present invention. A typical CCD sensor, 
such as in a camera, is actually an array of CCD sensor 
elements. These sensor elements are typically com- 
bined in a grid based pattern, as shown in figure 12A. A 
grid based pattern placement of these sensor elements 
may provide accurate results, but considering the cost 
of the sensor elements, it is desirable to utilize fewer 
sensors than required by a grid based placement, while 
still providing similar or better effectiveness. Alterna- 
tively, it is desirable to utilize the same number of sen- 
sors as a grid based placemerrt. while providing 
irrproved results. According to the present invention, 
the CCD sensor elements may be placed or configured 
according to a Low Discrepancy sequence. 
[0110] Rgure 12 is a flowchart diagram illustrating 
placement of the individual sensor elements of a CCD 
using a Low DiscreparKy sequence. The method oper- 
ates by first receiving the dimensions of the CCD panel 
from the user in step 522. In step 524 placement loca- 
tions are generated using a Low Discrepancy sequence 
comprising a determined number of sequence elements 
or results (the nurTt>er of sensor elements to be used). 
Here the computer 102 generates a Low Discrepancy 
sequerKe. and then determines placement locations 
using the Low Discrepancy sequence. The sensor ele- 
ments are then placed in the optimal locations in step 
526. The sensor elements may be placed by the user or 
by machinery during manufacture of tfie CCD panels. 
The sensor elements, placed aocordng to the Low Dis- 
crepancy sequence, provide better results than a sys- 
tem which uses sensor elements in a grid t>ased 
pattern. 

RgurQ 13 - Mesh D^^gn Ijsing Lqw Discrepancy 
Sequences 

[0111] Meshes are used by many engineering 
applications including mechanical, structural, arti 
design applications. Prior art typically uses a grid based 
mesh. If a mesh could be generated using less vertices, 
while achieving sutsstantially the same results, effi- 
dency my be increased. In addition, rt would also be 
desirable to generate a mesh with improved results over 
a grid based mesh. Therefore an irrproved method for 
determining mesh vertices is desired. 
[0112] Rgure 13 illustrates a method for aeating 
meshes using Low Discrepancy sequences. In step 702 
the computer receives the dimension of either a 2D or 
3D mesh. In step 704 the vertex locations are gener- 
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ated, within the 2D or 3D dimensions, by a Low Discrep- 
ancy sequence These vertices are then connbined In 
step 708 to create a full mesh of the desired dimension. 

Roures 15 and 16 - AoQuirina Data Set Statistics Using 
Low Discrepancy SamolinQ 

[0113] Computing the statistics of a data set such 
as a 1-D. 2-D, 3-D or n-D data set often required. For 
example, computing the ^t^tics of a signal may be an 
important aspect of many applications involving signals 
from sensors. For example, a voice recognition system 
is required to produce statistics regarding a voice signal 
in order to build a database from which to match future 
voice data Theses signal are typically acquired as a 
voltage signal from a microphone and stored in the 
computer memory. If a fewer number of signal samples 
are stored in memory, the recognition process n^y be 
faster and wore efficient Lew Disaepancy signal sanv 
pling may also by used in any application dealing with 
sound, vbration, acceleration, spectral matching, signal 
matching, frequency estimation, and dynarruc signal 
measuring. 

[01 14] Rgures 1 5 and 1 6 are flowcharts illustrating 
embodiments of producing statistics tor a data set The 
same method may be applied or adapted for generating 
statistics for any type of n-D data set, such as a 2-D or 
3-D image, a 3-D volume or other 3-D data set, or for a 
1-D data set, such as a signal. The present invention 
may also be reacfily extended to other n-dimensional 
data sets. Rgures 15 arxi 16 are deserved together 
below. 

[0115] In step 402A of Rgure 15, the computer 102 
receives and stores a data set in the computer. The data 
set may t)e received over a network, or may fiave been 
previously stored on the computer, such as by a user. In 
the case of a 1-D data set, e.g., a signal, the signal is 
received and stared in step 402B (Rgure 16). 
[0116] In step 404A of Figure 15, the data set is 
sampled using a Low Disaepancy sampling method. 
The sample points are preferably stored in memory. The 
number of sample points generated may be selected by 
a user or may be selected by the computer according to 
some desired accuracy metric. In the case of a 1 -D data 
set e.g., a signal, the data set of the signal is sampled 
in step 404B (Rgure 1 6) to produce a plurality of sample 
points which characterize the signal. 
[01 17] In step 420A the sample points are used to 
compute various data set statistics. More specifically, 
the computer 102 uses the sample points to compute 
various statistics according to various statistical gather- 
ing algorithms. This embo(£ment allows the desired sta- 
tistical information to be obtained from the sample 
points, instead of requiring all of the data set points to 
be used for this purpose. Because a reduced numt>er of 
strategically selected sample points are used (i.e., sanrv 
ple points selected using a Low Disaepancy sequence 
rather than a gid based, random, or any other selection 



metfKxJ). the nrtetftod's efficiency ts improved. In the 
case of a 1 -D data set, e.g.. a signal, data set statistics 
are computed i^ing the sample points of the signal in 
step420B (Rgure 16). 

5 [0118] In the absence of Low D^epancy sam- 
pling, either grid-based or random sampling would likely 
t>e used to determine sanple points for statistical gath- 
ering purposes. Experimental data has shown tfiat a 
Low Disaepancy sequence procbices better results 

10 than grid-based or random selection. 

Rgure 19 - SamolinQ of the Template Image 

[0119] Rgure 19 is a fbwchart diagram illustrating 

75 an alternate embodiment of the tennplate characteriza- 
tion or representation performed in step 404 of Rgure 5. 
Tfie flowchart of Rgure 1 9 thus illustrates an alternative 
method for representing an image, such as a template 
image, with a reduced number of sample pixels which 

20 accurately characterize the image. 

[01 20] As shown, in step 442 the image is sampled 
to produce a plurality of sarrple pixels which represent 
the image. In this embodiment the template image may 
be sampled using any of various sarrpling techniques, 

25 such as a uniform sarrpling technique, i.e., a uniform 
grid based sampling, a random sarrpling sequence, or 
using Low Disaepancy sequences such as the Halton 
or Sotx>l sequence as desabed with respect to step 
404 of Rgure 5. In the preferred embodiment, a Low 

30 Disaepancy sequence is used to sample the image 
because the Low Disaepancy sequence produces the 
fewest sample pixels or points which accurately charac- 
terize the image. 

[0121] After the sampling of the image has been 

35 performed to produce a plurality of sample pixels, in 
step 444 a kx:al stability analysis is performed for at 
least a subset of and preferat^ for all of the generated 
sample pixels to determine stability of the respective 
sample pixels to spatial perturt>ations. For each candi- 

40 date sarrple pixel value for which this local analysis is 
performed, the method operates to determine a neigh- 
borhood around the respective candidate sample pixel 
where the tenplate image pixel values corrprised in the 
neighborhood correlate highly with the candidate sam- 

45 pie pixel value. In other words, for each candidate sam- 
ple pixel value for which the kx:al stability analysis is 
performed, a correlation is performed with neighboring 
pixel values within the template image to determine if 
the candidate sample pixel value is stable within its 

50 neighborliood, i.e., the neighboring pixel values have 
similar or correlated values with the respective candi- 
date sample pixel value. 

[0122] In step 446 the method optionally operates 
to save only those candidate sample pixel values which 
55 have a requisite stability within a predetermined or pre- 
defined neighborhood size. Sairple pixel values gener- 
ated in step 442 which are rx3t stat)le within the pre- 
defined neighkx)rhood are preferably thrwn out or not 
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used. Thus, this method operates to further reduce the 
nurrber of sarrple pixel values used in the pattern 
matching operation. Stated another way, the method 
shown in Figure 19 operates to represent an image, 
such as a tennplate image used in pattern matching, 
with an even furth^ reduced numt}er of sample pixel 
points. 

[0123] In one embodiment of the invention, 
desabed below with respect to Rgure 20. after either of 
steps 444 or 446, in step 448 the method further oper- 
ates to find or detect cffferent respective stability 
regions or neightx)rtiood sizes for which each of the 
respective subset or all of the sarrple pixel values are 
stable, according to a stability criteria or varying statxiity 
levels. Stated another way. the method operates to 
detect and categorize subsets of sample pixel values 
with varying stability regions. I.e.. operates to categorize 
subsets of sannple pixel values according to stability 
region size. 

[0124] The different stability region sizes may also 
be used to determine a step size for stepping the 
respective sample pixels across the target image in the 
pattern matching process. This step size is used during 
the pattem matching operation to reduce the number of 
correlations rec^ired to be performed in the pattern 
matching. Thus, for a set of sample pixel values which 
have a larger stat>ility neightx>rtiood size, the set of 
sample pixel values can be stepped across the target 
image during the iterative correlation process with a 
larger step size A set of sanrple pixel values with a 
smaller stability neightx>rhood size are stepped across 
the target image during the iterative correlation process 
with a correspondingly smaller step size. 
[0125] As desCTit>ed below with respect to Figure 
20. in the sut>sequent pattern matching process, the 
sample pixel values having different stability neightx)r- 
hood sizes are then used in a coarse to fine search, 
preferably using the respective computed step sizes. 
Thus the method operates to determine different stabil- 
ity neighborhood sizes and corresponding step sizes for 
use in a coarse to fine pattern matching search. 
[01 26] As descrbed above, in machine vision appli- 
cations, generally a large or infinite amount of time is 
available for characterizing the template image. In con- 
trast, when the target Image is obtained, it is generally 
desirable for the pattern matching to occur as quickly as 
possible. Therefore, a relatively large amount of 
processing may be performed to characterize or repre- 
sent the template image, including sampling the tenrh 
plate image using Low Discrepancy sequences, local 
8tat>ility analysis for each of the sample pixel values arxi 
computation of desired step sizes. This pre-processing 
is not required to be performed in real tima Rather this 
pre-processing of the template image is performed to 
enable a faster pattem matching computation when the 
target image is acquired. 



Rgure 20 - Pattem Matching Usino Computed Step 

Sizes and Coarse to Rne Searching 

[0127] Rgure 20 is a flowchart diagram illustrating 

5 one embodiment of the pattern matching process per- 
formed in step 408 of Rgure 5. The flowchart of Rgure 
20 Dlustrates pattern matching using cfifferent stability 
neighborhood sizes and corresponding step sizes in a 
coarse to fine search. Steps which are similar or identi- 

10 cal with those in Rgures 5 and 19 have the same refer- 
ence numerals for convenience. 
[0128] As shown, in step 462 the metfiod operates 
to perform a coarse pattern matching using a f irst se* of 
sample pixel values which have a first stat>ility neighbor- 

75 hood size and a corresponding first step size. Thus the 
method performs a first iteration of pattern matching 
using the first set of sample pixel values and the first 
step size. The first set of sample pixels used for the ini- 
tial coarse pattern matching preferably have the largest 

20 stability neighbortKxxJ size and hence the largest step 
siza This coarse pattern searching produces zero or 
nrx>re possible locations for the template inr^ge in the 
target image. In other words, this coarse pattern search- 
ing produces zero or more candidate locations in the 

25 target image which possibly include the template image. 
[01 29] After step 462, in step 464 the metfKxJ oper- 
ates to perform a finer pattern matching at these possi- 
t)le locations or cancfidate locations using a second set 
of sample pixel values which have a second stability 

30 neighborhood size and a corresponding second step 
size, wherein the second stability neighkx)rtKXxi size 
arvi the second step size are smaller than the first sta- 
bility neighbortiood size and first step size. This finer 
pattern searching produces zero or more possit)le loca- 
ls tions for the template image in the target image, and 
typically invoh^es discarding one or wore false matches 
produced in the coarse search performed in step 462. 
[0130] Step 464 may be repeated one or more 
times to perform even finer pattem matching using other 

40 sets of sample pixel values which have even smaller 
stability neightx>rhood sizes and corresporxfing second 
step sizes. Step 464 is preferably repeated at the 
remaining candidate locations. After one or more itera- 
tions of step 464, the method may involve performing a 

45 final pattern matching in step 464 using all of the sanv 
pie pixel values to determine if any remaining possible 
matches are actual matches. Alternatively, after one or 
more iterations of step 464 and/or after a pattern match- 
ing step using all of the sample pixel values, in step 466 

50 the method further optionally performs a pattern match- 
ing using all of the template pixels for the remaining can- 
didate locations in the target in^ge. The number of 
iterations that are performed in step 464 depends on the 
degree of desired preciseness in the pattern matching. 

55 In a similar manner, the decision whether step 466 is 
performed also depends on the degree of desired pre- 
ciseness in the pattem matcfv'ng. 
[0131] Thus the pattern matching comprises per- 
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forming a pturalrty of iterations of pattern matching using 
different ones of the sets of sample pixels, preferat}ly 
with different step sizes. Where the locaJ stability arudy- 
sis determines a plurality of sets of sample pixels with 
differing stability neighbortxxxi sizes, the pattern 5 
matching comprises perfomiing a plura^ of iterations 
of pattern matching using differertt ones of said sets of 
sample pixels in a coarse to fine manner. e.g., with suc- 
cessively smaller stability neighborhood sizes and/or 
successively smaller step sizes. If a first iteration of pat- w 
tern matching determines one or more candidate loca- 
tions in the target image which possibly include the 
template image, then one or more second iterations of 
pattern matching are perfamed at the determined one 
or more cancfidate locations in the target imaga The is 
first iteration of pattern matching utilizes a first stability 
neighborhood size and a first step size, and each of the 
one or more second iterations of pattern matching pref- 
erabty utilize a smaller stability neightxKhood size and a 
smaller step size. 20 
[0132] As an example of the operation of the pat- 
tern matching performed in Figure 20. presume the 
method in step 448 detects a first set of sample pixel 
values which have a 9 x 9 stability neigtitx>rhood size 
arxJ a second set of sample pixel values with a 5x 5 sta- 2s 
txlity neighborhood size. etc. When performing the pat- 
tern matching search in step 462. the method preferably 
starts i^ing the sample pixel values which have the 
larger stability neighborhood size. e.g., the 9 x 9 stat)ility 
neighborhood size. TNs search also uses a step size 30 
con-esponding to this stability neighborhood size, e.g., a 
step size of 9 pixels. Thus, because these points or 
sample pixel values are stable over a 9 x 9 region, the 
search process is performed whereby, instead of visiting 
- each pixel in the target image to corrpute the match val- as 
ues, the pattern matching is preferably performed at a 
step size of every 9 pixels. 

[0133] Once this initial core search determines an 
initial set of possible matches, the second set of sample 
pixel values with a smaller neightx>rhood size, e.g.. with 40 
the 5 X 5 stability regiorrs. are used to perform a pattern 
matching at these initial match locations to perform a 
more refined search of these locations. This coarse to 
fine search based on stability neighborhood size and 
step size may be performed for a plurality of coarse to 4s 
fine iterations until a desired degree of pattern matohing 
has been accomplished. 



Figures 22a - 22f : ConoarinQ the Template Imaoe with 
Every Posstole Portion of the Taroet Imaoe 

[01 35] Rgures 22a - 22f DIustrate a prior art pattern 
matchir^ technique wherein the template image or 
sample pixels representing the template image are 
compared against every possa>le portion of the target 
image. In Rgures 22a - 22f, the shaded toUock repre- 
sents the template image or the sample pixels repre- 
senting the template image. 

[0136] As shown in Rgures 22a - 22f, in prior art 
pattem matching techniques the template image is 
compared with each possit)le portion of the target 
imaga TTius, for example, in Rgure 22a the tenrtplate 
image is compared with a conesponding portion of the 
target image at the i^yper left portion of the target 
imaga After this comparison has been performed, the 
template image is moved down one scan line of pixels 
as shown in Rgure 22b and compared with the next per- 
spective portion of the target image. After this compari- 
son, the template image is moved down again one pixel 
scan line as shown in Rgure 22c and is compared witii 
arxjther portion of the target imaga This is repeated a 
plurality of times until the template image reaches the 
very bottom left portion of the target image as shown in 
Rgure 22d. After the template image is corrpared with 
the tx>ttom left portion of the target image as shown in 
Rgure 22d, the template image, for example, is moved 
back to the very top of the targ^ image and moved 
across one vertical column of pixels to begin a new set 
of comparisons as shown in Rgure 22e. After this com- 
parison is performed in Rgure 22e, the template image 
is nmed down one horizontal scan line of pixels and 
compared with the next respective portion of the target 
image as shown in Rgure 22f. This operation again ~ 
repeats a plurality of times until tiie template image 
again reaches the bottom of the target imaga At this 
point the template image is moved back to the top of 
ttie target image and across one more vertical column 
of pixels (not shewn) to perform another set of compar- 
isons. The comparisons repeat until the template image 
has been compared with every possible corresponding 
portion of the target imaga As can be readily seen, this 
results in a large amount of computations. It is also 
noted that tiie template image may be moved in various 
manners across the target image, such as horizontally 
vertically, or combinations thereof. 



Rgure 21 - Pattern Matahinq Method of the Preferred 
Embodimqit 

[0134] Rgure 21 illustrates the pattern matching 
method desaibed atx]ve. Rgure 21 comprises the com- 
bination of Rgures 5, 19 arvJ 20 displayed in a single 
flowchart. 



Roures 23a - 23f : Comparing the Template Imaoe with 
50 the Target Imaoe Using a 9 Pixel Step Size 

[0137] Rgures 23a - 23f illustrate the pattem 
matching performed using a step size of 9 pixels from 
the example atxyva As shown, for the coarse search 
55 using a step size of 9 pixels, the template image is 
stepped across respective portions of the target image 
with a 9 pixel step size instead of a 1 pixel step size. In 
other words, as shown in Rgure 23a, the template 
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image, or the sample pixels representing the tenplate 
image, are Initially compared with a corresponding por- 
tion of the target image, such as the upper left corner of 
the target image. After this corrparison has t>een per- 
formed in Rgure 23a, the template image, for example, 
is moved downward 9 pixel scan lines as shown in Fig- 
ure 21b arxJ is compared with the next respective por- 
tion of the target im^e. After this comparison has t>een 
performed in Figure 23b. the template image ^ vno^eti 
another 9 scan lines downward as shown in Rgure 23c, 
and the sarrple pixels are again compared with the 
respective portion of the target image. The conrparisons 
are repeated until the tenplate image reaches the bot- 
tom left portion of the target image, as shown in Figure 
23d. After this comparison, the template image, for 
exannple, is moved back to the top of the target image 
and is moved over 9 vertical pixel columns to perform 
another comparison, as shown in Figure 23e. After this 
comparison is performed in Rgure 23e. the template 
image is moved down 9 horizontal scan lines of pixels 
arxi compared with the next respective portion of the 
target image as shown in Rgure 23f. This operation 
again repeats a plurality of times until the template 
image again reaches the bottom of the target image. At 
this point, the template image is moved back to the top 
of the target image and aaoss 9 more vertical column 
of pixels (not shown) to perform another set of compar- 
isons. This operation is performed until the terrplate 
image has been stepped across the entire target image, 
using a 9 pixel step size. It is noted thiat Rgures 23A - 
23f are merely an example of stepping the template 
image across the target image, it being noted that the 
template image may t>e stepped across the target 
image in any of various manners, i.e., left to right, right 
to left, top to bottom, bottom to top. or other methodolo- 
gies. 

Roures 24a - 24f : Comparino the Template Imaoe with 
th g T a rggt Im^gg Using q g Pix^ 9teP 3izQ 

[0138] Rgures 24a - 24f illustrate the pattern 
matching performed using a step size of 5 pixels from 
the example above. As shown, for the finer search using 
a step size of 5 pixels, the template image is stepped 
across respective portions of the target image with a 5 
pixel step size. In the preferred emtxxiiment, the finer 
search is only performed at focations which are indi- 
cated to be possible matches in the initial coarse 
search. 

[01 39] Thus, Rgure 23a - 23f illu^te performance 
of a pattern matching using a first set of sarrple pixel 
values with a larger stability r)eightx>rtKXxJ. Rgures 24a 
- 24f illustrate the pattern matching algorithm using a 
second set of sample pixel values with a smaller stability 
neightx>rtiood size and smaller step size, preferably per- 
formed at possible match locations incficated by the first 
pattem matching step. As discussed atx3ve with respect 
to step 464, this finer search may be repeated zero or 



more times, each iteration preferat>ly with a smaller step 
size and a greater numl>er of sanples. until a desired 
degree of predsion has k>een obtained. A final pattem 
matching iteration may involve using all pixete in the 

5 template image at the one or more locations in the tar- 
get image which are poss^e matches. 
[0140] It ^ noted that performing pattem matching 
using a ^ep size is a prior art technique However, prior 
art methods generally use the same sample pixels or 

10 template image regardless of step size. 

[0141] Therefore, in the preferred embodiment of 
the present inverrtfon, the method operates to select a 
subset of sarrple pixels for a respective pattern match- 
ing comparison based on a local stability analysis. The 

IS method of the present invention also operates to com- 
pute a step size based on a determined stability region 
or neighborfKXXf of the respective sample pixels. The 
method further operates to use different subsets of 
sample pixels and different conesponding step sizes in 

20 a coarse to fine analysis. 

Rgure 25 - Rotation Invariant Pattem Matching 

[01 42] Rgure 25 is a flowchart cfiagram illustratir^g a 
25 method for performing rotation invariant pattern match- 
ing. The method of Rgure 25 includes characterizing or 
representing the template image for rotation invariant 
matching. Thus, in Rgure 25 the objective is to effi- 
ciently sample the image to f irxl a reduced set of sample 
30 pixel values or points that characterize the tenplate 
accurately, and which are also conducive for f irxiing the 
template image in the target image irrespective of the 
orientation of the template image in the target image. 
Steps in Rgure 25 which are similar or identical to pre- 
ss -viously discussed steps fiave the same reference 
numerals for corrvenience. 

[0143] As shown in Figure 25, in step 402 the 

method receives / stores the terrplate imaga 

[0144] In step 502 the method operates to sample 

40 or locate pixel values in the template image along one or 
more rotationally invariant paths, e.g.. the circular 
perimeter of one or more circles. This essentially oper- 
ates to sample the image in a manner which is rotation- 
ally invariant, i.e., locate pixels in the terrplate image 

45 along one or wore circular perimeters or circular paths. 
[01 45] After step 502, in step 406 the target image 
is received and/or stored in the computer system. 
[0146] After the target image is received and/or 
stored in step 406, in step 504 the method performs pat- 

50 tern matching using the drcular perimeter sairple pixels 
and the target image. The pattern matching may be per- 
formed for each of the one or more circles located in the 
template image. This rotation invariant pattern matching 
preferak)ly uses a cyclic correlation. The cyclic correla- 

55 tion method first correlates the two signals, i.e., the 
samples pixels taken from the circular path and the 
respective pixels in the target image, to determine a cor- 
relation value. After this first correlation, the method 
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shifts one signal, e.g.. the sanple pixels, with respect to 
the other signal t>y one sanrple pixel and again perfornis 
a correlation. TNs process is repeated, preferatsty until 
all possft)le correlations have t>een perlormed. i.e., until 
the sanple pixels have been shifted t>ack to their origi- 
nal location. After each of these con-elations has been 
performed, the method determines the location andA>r 
rotation of maximum correlation. This provides informa- 
tion (good estimations) on the location and rotation of 
the terrplate image in the target image. 
[0147] The pattern matching performed in step 504 
may also be used to search for changes in size of the 
template image in the target imaga In other words, the 
pattern matching performed in step 504 may also be 
used to search for scaled versions (larger or smaller) of 
the template image. This is accomplished by scaling 
(increasing or deaeasing) the size of the search circles. 
More particularly, for scale invariant matching, the 
method uses sairple pixels from a respective circular 
perimeter from the terrplate (e.g., of radius "R"). During 
the pattem matching, the metfiod chariges the racfius of 
the search circle. The method increases the radius R 
when searching for patterns that are t>igger tfian the 
template image and decreases the radius R when 
searching for patterns in the image tfiat are smaller than 
thie terrplate image. 

Rqure 26 - Rotation Invariant Pattern Matching Indud- 
inc a Coarse to Fine Search 

[0148] Rgure 26 is a flowchart diagram illustrating a 
method for performing rotation invariant pattem match- 
ing using a coarse to fine search procedure. 
[0149] In step 402 the method receives / stores the 

- - template image. _ _ - 

[0150] In step 502 the nrrethod operates to locate 
pixel values in the template image along one or nfK>re 
rotationally invariant paths, e.g., along a circular perinv 
eter of one or more drdes. This essentially operates to 
sarrple the image in a manner which is rotationally 
invariant, i.e., locate sample pixels in the template 
image along one or more drcular perinrreters or circular 
paths. 

[01 51 ] In step 51 2 the method optionally performs a 
local stability analysis on the sarrple pixel values from 
each circular path to determine respective stability with 
respect to spatial perturt>ations. For each sample pixel, 
tiie local stability analysis comprises finding a neightXK- 
hood around the sample pixel where the value of the 
sample pixel conrelates highly witti the terrplate image 
pixel values in the neighborhood. In step 512 the 
method determines the stability region or neighborhood 
size for the sample pixels of each of the respective cir- 
cles. The method also preferat)ly corrputes a step size 
for each of the circles. The local stability analysis thus 
determines a plurality of sets of sanple pixels with dif- 
fering stability neightx>rhood sizes. 
[0152] In step 514 the method selects the sanple 



pixels of the most stable drde for the initial search proc- 
ess. Alternatively, the method selects an ordering of 
sample pixels from at least a siteet of the circles, pref- 
eratity from nrx>st stable to least stat)le. for use in the 

5 coarse to fine search. 

[0153] After step 514. in step 406 the target image 
is received and/or stored in the computer system. 
[0154] After the target image is received and/or 
stored in step 406. in step 522 the method perfornrrs pat- 

10 tern matching using the sample pixels from one or more 
of the most stat)le drcles. The method preferat)ly com- 
pares the sample pixels with a plurality of portions of tiie 
target images, optionally using the oonputed step size 
to step the sanple pixels across ttie targ^ image. The 

15 pattem matching performed in step 522 preferably 
determines zero or more candidate locations where a 
rotated version of the template image nray be located. 
This pattern matching also preferably determines a 
rotation value indicating the posslt)le rotation of the tem- 

20 plate image in the target image based on the maximum 
correlation value obtained in the cydic correlation. 
[0155] After step 522, in step 524 the method per- 
forms pattern matching usirrg sample pixels from one or 
more ottier drdes to improve results. In the preferred 

25 errtxxliment the method performs a coarse to fine 
search, wherein in step 522 tiie method determines one 
or more candidate locations arxi corresponding rotation 
values where the tennplate image may be located. In 
step 524 the metixxJ performs pattern matching using 

30 sample pixels from one or more other less stat)le drdes 
at these candidate locations and preferably using these 
rotation values. Thus, the mefliod performs a coarse to 
fine search process as desait>ed atxive, wherein sam- 
ple pixel values for the most stat)le drcular path are first 

35 used in an initial search process, and then sample pixel 
values from additional drdes are used at possible 
nratch locations to inprove the initial search results and 
accurately determine tiie terrplate*s position and rota- 
tion in the image. 

40 [0156] The rotation invariant pattem matching 
method preferably utilizes non-overlapping drcular 
paUis in ttie image. Also, in the preferred enrbodiment 
the method uses multiple drdes to reject false matches. 
The metiiod also may use concentric drdes. as 

45 desired. Rgures 27A and 27B illustrate the characteri- 
zation of the tenplate image (a printed drcuit board) for 
rotation invariant matching using sample pixels taken 
from one or nrx>re circular pats. Rgure 27A shows the 
use of sample pixels from concentric drdes. and Rgure 

50 27B shows tiie use of non-concentric, non-overiapping 
drdes. Rgures 27A and 27B also show an exanple 
template image which is desired to be found in the tar- 
get image. Rgure 28 is an actual screen shot illustrating 
the use of concentric and non-concentric drdes. 

55 [9157] After step 524. in step 526 tire method 
optionally performs a pattern matdiing using all of the 
terrplate image pixels, preferably using a rotation value 
determined in either of steps 522 or 524 to rotate tire 
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tenrplate image pixels prior to the pattern matchir^. In 
other words, the template Image ^ rotated to approxi- 
matety match the orientation of the candidate template 
image in the target image, and then the patten match- 
ing is perfamed using aD of the template image pixels. 
This rotation of the template inr^ge prior to the pattern 
matching Is necessary since the entire template inrtage 
is not rotationally invariant. 

[0158] After the pattern matching performed in 
steps 522, 524 and/or 526. the metfuxi then generates 
the results in step 410. In this case, the results include 
the location of zero or more template image Instances in 
the target image, as well as the rotation or orientation of 
each instance. 

[01 59] The pattern matching performed in step 504 
and/or the methods desaibed in Figures 25 and 26 may 
also be used to search for changes In size of the ten>- 
plate image in the target image In other words, the pat- 
tern notching performed in step 504 may also used 
to search for scaled versions (larger or smaller) of the 
template image. This Is accomplished by scaling 
(increasing or decreasing) the size of the search drdes. 
More particularly, for scale invariant matching, the 
method uses sample pixels from a respective circular 
perimeter from the template (e.g., a drde of radius "R"). 
During the pattem matching, the method changes the 
radius of the search drde. The method increases the 
radius R when searching for patterns that are bigger 
than the template image and decreases the radius R 
when searching for patterns in the Image that are 
smaller than the template image. 
[0160] Although the system and method of the 
present invention is descrbed in connection with sev- 
eral emtxxJiments. it Is not interxJed to be limited to the 
spedfic forms set forth herein, but on the contrary, it is 
intended to cover such alternatives, modifications, and 
equivalents, as can be reasonat^ty Induded within the 
spirit arxi scope of the Invention as defined by the 
appended daims. 

Claims 

1 . A computer-implemented method for characterizing 
an in^age, the method comprising: 

receiving the image, wherein the image com- 
prises a first plurality of pixels; 
sarrpling the image using a Low Discrepancy 
sequence to detennine a plurality of sample 
pixels in the image which characterize the 
image; and 

storing the plurality of santple pixels in a menv 
ory of the computer system, wherein the plural- 
ity of sample pixels characterize the Image. 

2. The metlKx) of daim 1 wherein the Low Dlsaep- 
ancy sequence is a quasi-random sequence. 



3. The method of daim 1 or 2, wherein the Low Dis- 
aepancy sequence is designed to produce sample 
points which maximally sc^d each other. 

5 4. The method of any of the preceding dainrts. wherein 
said Low Discrepancy sequence sampling results 
in fewer points to diaracterlze the Image than a uni- 
form or random sequence. 

10 5. Themethodof any of the preceding dainrs. wherein 
the Low Discrepancy sequence is a sequence 
selected from the groip comprising: Klalton, Sobol. 
Faure. and Niederrerter. 

IS 6. Themethodof any of the preceding daims. wherein 
said sampling the image using a Low Disaepancy 
sequence comprises: 

generating the Low Discrepancy sequence; 
20 selecting pixels in the image using the Low Dis- 

crepancy sequence to determine a plurality of 
sample pixels in the image which characterize 
the image. 

25 7. The method of any of the preceding daims. further 
comprising: 

receiving user input indicating a desired granu- 
larity of an image characterization; 
30 wherein the method generates a number of 

sample pixels based on the desired granularity 
of the in^ge characterization. 

8. The method of any of the preceding daims. 
35 - wherein said sampling determines a second plural- 
ity of sample pixels, wherein said second plurality is 
less than said first plurality; 

the method further comprising: 
40 performing a local stability analysis for at least 

a sut^set of said sample pixels, wherein said 
performing said local stability analysis deter- 
mines a third plural'rty of sample pixels which 
have a desired degree of stability, wherein said 
45 third plurality Is less than said secorxJ plurality; 

wherein said storing comprises storing the third 
plurality of sample pixels In the memory of the 
computer system. 

50 9. The method of any of daim 8. wherein said per- 
forming the local stability analysis operates to 
ensure stability of each of said sut>set of sample 
pixels to spatial perturt>ations around the sanrple 
pixel. 

55 

1 0. The method of daim 8, wherein said performing the 
local stability analysis for each of said at least a 
sut>set of said sample pixels comprises: 
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for each sample pixel, finding a neighborhood 
around the sanple pixel where the value of the 
sample pixel correlates highly with the template 
Image pixel values in the neighborhood. 

5 

11. The method of any of the preceding claims, 
wherein the image is a template image used in pat- 
tern matching: 

the method further comprising: io 
receiving a target image; 
corrparing the sample pixels in the tenrplate 
image with pixels in the target image to deter- 
mine one or nrx>re instances of the template 
image in the target imaga is 

1 2. The method of any of the preceding daims. further 
comprising: determining image statistics based on 
the sample pixels. 

20 

13. The method of any of the preceding daims. wherein 
said sampling the image and said storing the plural- 
ity of sample pixels are performed by a first corrpu- 
ter system; 

25 

the metfxxJ further comprising: 
the first corrputer system transmitting the sam- 
ple pixels to a second corrputer system over a 
network; 

the second computer system displaying the 30 
sarrple pixels. 

14. The method of claim 13. further comprising: 

-the second computer system reconstructing 35 
pixels from the image which were not received, 
wherein said reconstructed pixels are dis- 
played with the sample pixels to display a more 
corrplete image. 

40 

1 5. The method of any of the preceding daims, wherein 
the image is a search image used in motion estima- 
tion; the method further comprising: 

receiving a target image, 4S 
corrparing the sample pixels in the search 
image with pixels in the target image to deter- 
mine a motion vector. 

16. A system for characterizing an image, wherein the so 
image corrprises a first plurality of pixels, the sys- 
tem conprising a memory which stores the image, 

a processor coupled to the memory which is opera- 
ble to sample the image, wherein the memory is 
operable to store a plurality of sarrple pixels, said 55 
system being able to carry out a method of any of 
daims 1 through 15. 



17. The system of daim 16. wherein the system is a 
machine vision system. 

18. A memory medum which corrprises program 
instructions for carrying out a method of any of 
daims 1 through 15. 

19. A system for transmitting an image, the system 
comprising: 

a first corrputer system, conprising: 

a memory which stores the image, wherein 
the image comprises a first plurality of pix- 
els; 

a processor coupled to the memory which 
is operable to sample the image i^ng a 
Low Discrepancy sequence to determine a 
plurality of sample pixels in the image 
which characterize the image: 
a trar^mitter coupled to the memory which 
is operable to transmit the sairple pixels 
over a networi^; 

a second computer system coupled to the first 
computer system over the network, compris- 
ing: 

an input for receiving the sample pixels; 
and 

a display for dsplaying the sanple pixels. 

20. The system of daim 19. wherein the second com- 
puter system is operable to reconstruct pixels from 
the image which were not receivedr wherein said 
reconstructed pixels are displayed with the sarrple 
pixels to display a more corrplete image. 

21. A computer-irrplemented method for placing sen- 
sors in an area for coverage of the area, the method 
comprising: 

generating a Low Discrepancy sequence; 
placing the sensors at locations in the area 
according to the Low Discrepancy sequence. 

22. The method of daim 21, wherein the area is a 2- 
(£mensional area. 

23. The method of daim 21, wherein the area is a 3- 
cfimensional volume. 

24. The method of any of daims 21 through 23, further 
comprising: 

receiving information on the area in response 
to user input wherein said information indudes 
dimensions of the area; 
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wherein said generating the Low Discrepancy 
sequence is performed based on said Informa- 
tion. 

25. The method of any of claims 21 through 24, s 
wherein the area is determined by the computer 
based on the type and number of sensors to be 
placed. 



characterize the template image; 
perming pattern matching using the sample 
pixels and the target image to determine zero 
or more locations of the template image in the 
target intage. 

32. The method of daim 31 and of any of claims 2 
through 5 and 8 through 10. 



26. The method of any of claims 21 through 25. io 
wherein the Low Disaepancy sequerx^e is a quasi- 
random sequence. 

27. The method of any of claims 21 through 26. 
wherein the Low Discrepancy sequence is is 
designed to produce sample points which maxi- 
mally avoid each other. 

28. The method of any of daims 21 through 27, 
wherein the Low Discrepancy sequence is a ^ 
sequence selected from the group comprising: 

Halton, Sobol. Faure, and Niederreiter. 

29. The method of any of claims 21 through 28. the 25 
method comprising: 

receiving information on the area in response 
to user input, v^erein said information indudes 
dimensions of the area; 30 
generating a Lew Discrepancy sequence, 
wherein the Low Discrepancy sequence is gen- 
erated based on said information; 
pladng the sensors at locations in the area 
accdirling to the Low Discrepancy sequence. ss 

30. A computer-implemented method for constructing a 
CCD sensor comprising a plurality of CCD sensor 
elentents, the method comprising: 

40 

generating a Low Discrepancy sequence, 
wherein elements of the Low Discrepancy 
sequence indicate locations of the CCD sensor 
elements; 

constructing the CCD sensor, wherein said 45 
constructing indudes pladng the CCD sensor 
elements at locations in the CCD sensor 
according to the Low Discrepancy sequence. 

31. A method for performing pattern matching to locate so 
a template image in a target image, wherein the tar- 
get image is larger than the template image, 
wherein the template image comprises a first plural- 
ity of pixels, the method comprising: 

55 

sampling the template image using a Low Dis- 
crepancy sequerrce to determine a plurality of 
sample pixels in the template image which 



33. The metfxxJ of claims 32 and 8, wherein said per- 
forming the local stability analysis determines a first 
set of sample pixels with a first stability neightx>r- 
hood size and a second set of sarrple pixels with a 
secorxj stability neighborhood size, wherein the 
first stability neighborhood size is greater than the 
second stability neightx>rhood size; 

wherein said performing pattern matching com- 
prises: 

performing a first iteration of pattern matching 
using the first set of sample pixels having the 
first stability neighbortKXxJ size; 
wherein said first iteration of pattern matching 
determines one or more candidate locations in 
the target image which possibly indude the 
template image; and 

performing a second iteration of pattern match- 
ing using the second set of sample pixels hav- 
ing the second stability neighborhood size at 
said determined one or more candidate loca- 
tfons in the target image. 

34. The method of daim 33. wherein said performing 
the pattem matching utilizing the first stability 

neightx>rhood size indudes using a first step size, 

and wherein the performing pattern matching using 

the second stability neighborhood size utilizes a 
second step size, wherein said first step size is 
greater than said secorxi step size. 

35. The method of claim 34. wherein said first step size 
corresponds to said first stability neighborhood size 
and wherein said second step size corresponds to 
said second stability neighborhood size. 

36. The method of any of daims 31 tiirough 35. further 
corrprising: 

receiving the target image after said sampling 
the template image, wherein said performing 
pattern matching is performed in response to 
receiving the target image, wherein said pat- 
tern matching is performed substantially in real 
time after receiving the target image. 

37. A system for perfornrvng pattern matching to locate 
a template image in a target Image, wherein the tar- 
get image is larger tfian the template image. 
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wherein the template image comprises a first plural- 
ity of pixels, the system comprising a menrK>ry 
which staes the template image, a processor cou- 
pled to the menrx>ry which \s operable to sample the 
template image, wherein the processor is operable 
to perform pattern matching, said system b^ng 
able to carry out the method of any of dains 31 
through 36. 

38. The system of daim 37. wherein the system is a 
machine vision system. 

39. A memory medium which comprises program 
instructions for carrying out the method of any of 
claims 31 through 36. 

40- A method for performing pattern matching to locate 
one or more instances of a template image in a tar- 
get image, wherein the template iwage compr^ a 
first plurality of pixels, the method corrprising: 

sampling the tenplate image to produce a sec- 
ond plurality of sample pixels, wher^n said 
second plurality of sample pixels is less than 
the first plurality of pixels in the template image; 
performing a local stability analysis around at 
least a subset of said sanrple pixels, wherein 
said performing said local stability analysts 
determines a third plurality of sample pixels 
which have a desired degree of stability, 
wherein said third nunrt>er is less than said sec- 
ond number; 

performing pattern matching using the third 
plurality of sample pixels ar>d the target image 
- to determine zero or rTX)re locations of the tem- 
plate image in the target image. 

41 . A method for performing pattern matching to locate 
one or nfx>re instances of a tennplate image in a tar- 
get image, wherein the template image comprises a 
first plurality of pixels, the method comprising: 

sampling the tenplate image to produce a sec- 
OTKl plurality of sanrple pixels, wherein said 
second plurality of sample pixels is less than 
the first plurality of pixels in the template image; 
performing a local stability analysis around at 
least a sut>set of said sanple pixels, wherein 
said performing said local stability analysis 
determines a plurality of sets of sample pixels 
with differing stability neighborhood sizes; 
performing pattem matching using the sample 
pixels and the target image to determine zero 
or more locations of the template image in the 
target image, wherein said performing pattern 
matching corrprises performing a plurality of 
iterations of pattern matching using different 
ones of said sets of sample pixels. 



42. A method for performing pattem matching to locate 
one or more instances of a template image in a tar- 
get image the method oorrprising: 

5 sanpling the tenplate image to determine a 

plurality of sample pixels which desabe the 
template image; 

determining stability neightx)rhood information 
for at least a subset of the sarrple pixels; 

10 determining a step size based on said stability 

neighborhood information; performing pattem 
matching by comparing at least a subset of the 
sample pixels representing the template image 
with portions of the target image, wherein said 

15 performing pattem matching uses said step 

size in stepping the at least a subset of the 
sample pixels aaoss the target image. 

43. A n^ethod for performing pattern matching to locate 
20 one or nfv>re instances of a template image in a tar- 
get image, wherein the template image comprises a 
first plurality of pixels, the method comprising: 

performing a local stability analysis around at 
25 least a subset of said pixels, wherein said per- 

forming said local stability analysis determines 
a plurality of sets of pixels with differing stability 
neightx)rhood sizes; 

performing pattern matching using the pixels 
30 and the target image to determine zero or rTK>re 

locations of the template image in the target 
image, wherein said performing pattern match- 
ing comprises performing a plurality of itera- 
tions of pattern matching using different ones 
35 of said sets of pixels. - _ _ _ _ 

44w A method for performirtg pattern matching to locate 
one or nK>re instances of a rotated template image 
in a target image, the method comprising: 

40 

sanpling the template image along one or 
nfK>re rotationatly invariant paths to produce 
one or nrxx-e sets of sample pixels; 
perfornvng pattern matching using each of the 

45 one or nnore sets of sanple pixels and the tar- 

get image to determine zero or mote locatior^ 
of the template image in the target image, 
wherein said pattern matching detects rotated 
versions of the tenplate image in the target 

50 image. 

45. The method of daim 44, wherein said rotationalty 
invariant paths comprise circular paths. 

55 46. A method for performing pattem matching to locate 
one or more instances of a scaled template image 
in a target image, the method comprising: 
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sanrpling the template image along one or 
more circular perimeters to produce one or 
more sets of sample pixete; 
performing pattern matching using each of the 
one or more sets of sample pixels and the tar- s 
get image to determine zero or more locations 
of the tenrplate image in the target image, 
wherein said pattern matching detects scaled 
versions of the template image in the target 
image. 10 
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